Apr 13 15:01:01 user devstack@n-api.service[61870]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 13 15:01:01 user devstack@n-api.service[61870]: *** Starting uWSGI 2.0.20-debian (64bit) on [Thu Apr 13 15:01:01 2023] *** Apr 13 15:01:01 user devstack@n-api.service[61870]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 13 15:01:01 user devstack@n-api.service[61870]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 13 15:01:01 user devstack@n-api.service[61870]: nodename: user Apr 13 15:01:01 user devstack@n-api.service[61870]: machine: x86_64 Apr 13 15:01:01 user devstack@n-api.service[61870]: clock source: unix Apr 13 15:01:01 user devstack@n-api.service[61870]: pcre jit disabled Apr 13 15:01:01 user devstack@n-api.service[61870]: detected number of CPU cores: 12 Apr 13 15:01:01 user devstack@n-api.service[61870]: current working directory: / Apr 13 15:01:01 user devstack@n-api.service[61870]: detected binary path: /usr/bin/uwsgi-core Apr 13 15:01:01 user devstack@n-api.service[61870]: your processes number limit is 63637 Apr 13 15:01:01 user devstack@n-api.service[61870]: your memory page size is 4096 bytes Apr 13 15:01:01 user devstack@n-api.service[61870]: detected max file descriptor number: 2048 Apr 13 15:01:01 user devstack@n-api.service[61870]: lock engine: pthread robust mutexes Apr 13 15:01:01 user devstack@n-api.service[61870]: thunder lock: enabled Apr 13 15:01:01 user devstack@n-api.service[61870]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 13 15:01:01 user devstack@n-api.service[61870]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 13 15:01:01 user devstack@n-api.service[61870]: Python main interpreter initialized at 0x5584f8517990 Apr 13 15:01:01 user devstack@n-api.service[61870]: python threads support enabled Apr 13 15:01:01 user devstack@n-api.service[61870]: your server socket listen backlog is limited to 100 connections Apr 13 15:01:01 user devstack@n-api.service[61870]: your mercy for graceful operations on workers is 90 seconds Apr 13 15:01:01 user devstack@n-api.service[61870]: mapped 537436 bytes (524 KB) for 3 cores Apr 13 15:01:01 user devstack@n-api.service[61870]: *** Operational MODE: preforking *** Apr 13 15:01:01 user devstack@n-api.service[61870]: *** uWSGI is running in multiple interpreter mode *** Apr 13 15:01:01 user devstack@n-api.service[61870]: spawned uWSGI master process (pid: 61870) Apr 13 15:01:01 user devstack@n-api.service[61870]: spawned uWSGI worker 1 (pid: 61871, cores: 1) Apr 13 15:01:01 user devstack@n-api.service[61870]: spawned uWSGI worker 2 (pid: 61872, cores: 1) Apr 13 15:01:01 user devstack@n-api.service[61870]: spawned uWSGI worker 3 (pid: 61873, cores: 1) Apr 13 15:01:01 user devstack@n-api.service[61870]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 13 15:01:02 user devstack@n-api.service[61873]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 15:01:02 user devstack@n-api.service[61872]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 15:01:02 user devstack@n-api.service[61871]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 15:01:06 user devstack@n-api.service[61873]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 15:01:06 user devstack@n-api.service[61873]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 15:01:06 user devstack@n-api.service[61873]: and ``live_migration_inbound_addr`` respectively. Apr 13 15:01:06 user devstack@n-api.service[61873]: ). Its value may be silently ignored in the future. Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 15:01:06 user devstack@n-api.service[61872]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 15:01:06 user devstack@n-api.service[61872]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 15:01:06 user devstack@n-api.service[61872]: and ``live_migration_inbound_addr`` respectively. Apr 13 15:01:06 user devstack@n-api.service[61872]: ). Its value may be silently ignored in the future. Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 15:01:06 user devstack@n-api.service[61871]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 15:01:06 user devstack@n-api.service[61871]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 15:01:06 user devstack@n-api.service[61871]: and ``live_migration_inbound_addr`` respectively. Apr 13 15:01:06 user devstack@n-api.service[61871]: ). Its value may be silently ignored in the future. Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61873) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61872) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61871) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 15:01:06 user devstack@n-api.service[61873]: INFO dbcounter [None req-703ad239-cc59-45f4-89a3-bb624cfa179a None None] Registered counter for database nova_api Apr 13 15:01:06 user devstack@n-api.service[61872]: INFO dbcounter [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] Registered counter for database nova_api Apr 13 15:01:06 user devstack@n-api.service[61871]: INFO dbcounter [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] Registered counter for database nova_api Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG oslo_db.sqlalchemy.engines [None req-703ad239-cc59-45f4-89a3-bb624cfa179a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61873) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writer thread running {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG oslo_db.sqlalchemy.engines [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61871) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writer thread running {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG oslo_db.sqlalchemy.engines [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61872) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writer thread running {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG nova.context [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),10bda8e5-63c9-4a44-a524-4a0d8ed07a69(cell1) {{(pid=61871) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:01:06 user devstack@n-api.service[61871]: INFO dbcounter [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] Registered counter for database nova_cell0 Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG nova.context [None req-703ad239-cc59-45f4-89a3-bb624cfa179a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),10bda8e5-63c9-4a44-a524-4a0d8ed07a69(cell1) {{(pid=61873) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 15:01:06 user devstack@n-api.service[61871]: INFO dbcounter [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] Registered counter for database nova_cell1 Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-703ad239-cc59-45f4-89a3-bb624cfa179a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-703ad239-cc59-45f4-89a3-bb624cfa179a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-703ad239-cc59-45f4-89a3-bb624cfa179a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-703ad239-cc59-45f4-89a3-bb624cfa179a None None] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-703ad239-cc59-45f4-89a3-bb624cfa179a None None] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG oslo_db.sqlalchemy.engines [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61871) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-703ad239-cc59-45f4-89a3-bb624cfa179a None None] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writer thread running {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG oslo_db.sqlalchemy.engines [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61871) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 15:01:06 user devstack@n-api.service[61873]: INFO dbcounter [None req-703ad239-cc59-45f4-89a3-bb624cfa179a None None] Registered counter for database nova_cell0 Apr 13 15:01:06 user devstack@n-api.service[61873]: INFO dbcounter [None req-703ad239-cc59-45f4-89a3-bb624cfa179a None None] Registered counter for database nova_cell1 Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG oslo_db.sqlalchemy.engines [None req-703ad239-cc59-45f4-89a3-bb624cfa179a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61873) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG nova.context [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),10bda8e5-63c9-4a44-a524-4a0d8ed07a69(cell1) {{(pid=61872) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writer thread running {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG oslo_db.sqlalchemy.engines [None req-703ad239-cc59-45f4-89a3-bb624cfa179a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61873) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:01:06 user devstack@n-api.service[61872]: INFO dbcounter [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] Registered counter for database nova_cell0 Apr 13 15:01:06 user devstack@n-api.service[61872]: INFO dbcounter [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] Registered counter for database nova_cell1 Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG oslo_db.sqlalchemy.engines [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61872) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writer thread running {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG oslo_db.sqlalchemy.engines [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61872) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writer thread running {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 15:01:06 user devstack@n-api.service[61871]: INFO dbcounter [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] Registered counter for database nova_cell0 Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG oslo_db.sqlalchemy.engines [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61871) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 15:01:06 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writer thread running {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writer thread running {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 15:01:06 user devstack@n-api.service[61873]: INFO dbcounter [None req-703ad239-cc59-45f4-89a3-bb624cfa179a None None] Registered counter for database nova_cell0 Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG oslo_db.sqlalchemy.engines [None req-703ad239-cc59-45f4-89a3-bb624cfa179a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61873) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 15:01:06 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writer thread running {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writer thread running {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 15:01:06 user devstack@n-api.service[61872]: INFO dbcounter [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] Registered counter for database nova_cell0 Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG oslo_db.sqlalchemy.engines [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61872) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 15:01:06 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writer thread running {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 15:01:06 user devstack@n-api.service[61871]: WARNING keystonemiddleware.auth_token [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 15:01:06 user devstack@n-api.service[61871]: WARNING keystonemiddleware.auth_token [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 15:01:06 user devstack@n-api.service[61872]: WARNING keystonemiddleware.auth_token [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 15:01:06 user devstack@n-api.service[61872]: WARNING keystonemiddleware.auth_token [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 15:01:07 user devstack@n-api.service[61873]: WARNING keystonemiddleware.auth_token [None req-703ad239-cc59-45f4-89a3-bb624cfa179a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 15:01:07 user devstack@n-api.service[61873]: WARNING keystonemiddleware.auth_token [None req-703ad239-cc59-45f4-89a3-bb624cfa179a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 15:01:07 user devstack@n-api.service[61871]: WARNING keystonemiddleware.auth_token [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 15:01:07 user devstack@n-api.service[61871]: WARNING keystonemiddleware.auth_token [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 15:01:07 user devstack@n-api.service[61871]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584f8517990 pid: 61871 (default app) Apr 13 15:01:07 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:01:07 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001583 Apr 13 15:01:07 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Thu Apr 13 15:01:07 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:01:07 user devstack@n-api.service[61873]: WARNING keystonemiddleware.auth_token [None req-703ad239-cc59-45f4-89a3-bb624cfa179a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 15:01:07 user devstack@n-api.service[61873]: WARNING keystonemiddleware.auth_token [None req-703ad239-cc59-45f4-89a3-bb624cfa179a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 15:01:07 user devstack@n-api.service[61873]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584f8517990 pid: 61873 (default app) Apr 13 15:01:07 user devstack@n-api.service[61872]: WARNING keystonemiddleware.auth_token [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 15:01:07 user devstack@n-api.service[61872]: WARNING keystonemiddleware.auth_token [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 15:01:07 user devstack@n-api.service[61872]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584f8517990 pid: 61872 (default app) Apr 13 15:03:14 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:03:14 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-d994d2f9-03e4-46ed-ba76-4714a7a44991 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001630 Apr 13 15:03:14 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 15:03:14 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:03:14 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=3 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:03:14 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=3 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:03:14 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=3 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:03:14 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=3 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:03:14 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-6d783048-d6d6-43b4-97ee-f118d9ae5b3d admin admin] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:03:14 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-6d783048-d6d6-43b4-97ee-f118d9ae5b3d admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.375927 Apr 13 15:03:14 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 13 15:03:14 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:03:16 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:03:16 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001928 Apr 13 15:03:16 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 15:03:16 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:03:16 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:03:16 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:03:16 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:03:16 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:03:17 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-1cd10f0c-546f-4f9e-b8bb-08450a3eae74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "vcpus": 1}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:17 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-1cd10f0c-546f-4f9e-b8bb-08450a3eae74 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.330007 Apr 13 15:03:17 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 15:03:16 2023] POST /compute/v2.1/flavors => generated 405 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:03:17 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7e76c612-7933-47f8-bff7-1e1a879c9dfe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:17 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7e76c612-7933-47f8-bff7-1e1a879c9dfe admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048661 Apr 13 15:03:17 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 15:03:17 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:03:19 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:03:19 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001345 Apr 13 15:03:19 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 15:03:19 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:03:19 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-402f412e-95a0-4cf6-8bd4-912288ed068f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds512M", "id": "d1", "vcpus": 1, "disk": 5, "ram": 512}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:19 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-402f412e-95a0-4cf6-8bd4-912288ed068f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.104987 Apr 13 15:03:19 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 15:03:19 2023] POST /compute/v2.1/flavors => generated 402 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:03:19 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7614a6be-5b6b-41c3-b895-35f86d9130f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:19 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7614a6be-5b6b-41c3-b895-35f86d9130f7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027151 Apr 13 15:03:19 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 15:03:19 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:03:21 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:03:21 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001460 Apr 13 15:03:21 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 15:03:21 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:03:21 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-30feb028-8be7-4988-9ab2-61c000ef362e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "ram": 1024, "vcpus": 1, "name": "ds1G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:21 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-30feb028-8be7-4988-9ab2-61c000ef362e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.066156 Apr 13 15:03:21 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 15:03:21 2023] POST /compute/v2.1/flavors => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:03:21 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-b0c36da3-866e-4a05-8a44-3c65ab53ba85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:21 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-b0c36da3-866e-4a05-8a44-3c65ab53ba85 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026905 Apr 13 15:03:21 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 15:03:21 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:03:23 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:03:23 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001373 Apr 13 15:03:23 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 15:03:23 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:03:23 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-04740f79-c416-49d3-9049-72a354dc52cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "vcpus": 2, "disk": 10, "name": "ds2G", "rxtx_factor": 1.0, "id": "d3"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:23 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-04740f79-c416-49d3-9049-72a354dc52cb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.063487 Apr 13 15:03:23 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 15:03:23 2023] POST /compute/v2.1/flavors => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:03:23 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-675ff1f7-09b9-4647-8766-1f68c5cf0b74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:23 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-675ff1f7-09b9-4647-8766-1f68c5cf0b74 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023839 Apr 13 15:03:23 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 15:03:23 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:03:25 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:03:25 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001364 Apr 13 15:03:25 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 15:03:25 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:03:25 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-6ecfa94a-8eb0-46d0-b6ab-e3ca2d22f3e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:25 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-6ecfa94a-8eb0-46d0-b6ab-e3ca2d22f3e0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.060853 Apr 13 15:03:25 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 15:03:25 2023] POST /compute/v2.1/flavors => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:03:25 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7947dde8-2636-4e76-93a7-d55c04593e2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:25 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7947dde8-2636-4e76-93a7-d55c04593e2b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023499 Apr 13 15:03:25 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 15:03:25 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:03:26 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:03:26 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-4cac16ca-7c44-461d-b8fb-57e2b339be0e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001411 Apr 13 15:03:26 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 15:03:26 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:03:27 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-bd2bdd2b-d6e2-4dc5-814a-171b7a69b1e6 admin admin] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:03:27 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-bd2bdd2b-d6e2-4dc5-814a-171b7a69b1e6 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.071681 Apr 13 15:03:27 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 13 15:03:26 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 13 15:03:29 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7947dde8-2636-4e76-93a7-d55c04593e2b admin admin] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:03:29 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7947dde8-2636-4e76-93a7-d55c04593e2b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001442 Apr 13 15:03:29 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 15:03:29 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:03:29 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=3 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:03:29 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=3 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:03:29 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=3 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:03:29 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=3 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:03:29 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-240fd111-8958-4aa1-8d16-6722c171ea70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "ram": 512, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:29 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-240fd111-8958-4aa1-8d16-6722c171ea70 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.386367 Apr 13 15:03:29 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 15:03:29 2023] POST /compute/v2.1/flavors => generated 400 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:03:29 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-a571d300-d973-41a4-9f36-412bdf13cdba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:29 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-a571d300-d973-41a4-9f36-412bdf13cdba admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042030 Apr 13 15:03:29 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 15:03:29 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:03:31 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7947dde8-2636-4e76-93a7-d55c04593e2b admin admin] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:03:31 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7947dde8-2636-4e76-93a7-d55c04593e2b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001362 Apr 13 15:03:31 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 15:03:31 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:03:32 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-71ed544d-1b63-48d8-9d9c-d9094a4a5620 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 2048, "name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "disk": 20, "swap": 0}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:32 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-71ed544d-1b63-48d8-9d9c-d9094a4a5620 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.102688 Apr 13 15:03:32 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 15:03:31 2023] POST /compute/v2.1/flavors => generated 403 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:03:32 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-ba637f58-4943-4c8f-b11a-23605fcabe85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:32 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-ba637f58-4943-4c8f-b11a-23605fcabe85 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034702 Apr 13 15:03:32 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 15:03:32 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:03:34 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7947dde8-2636-4e76-93a7-d55c04593e2b admin admin] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:03:34 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7947dde8-2636-4e76-93a7-d55c04593e2b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001337 Apr 13 15:03:34 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 15:03:34 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:03:34 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-a9d625c4-0527-419b-86d2-081bf476c9c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "ram": 4096, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:34 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-a9d625c4-0527-419b-86d2-081bf476c9c8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.063789 Apr 13 15:03:34 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 15:03:34 2023] POST /compute/v2.1/flavors => generated 404 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:03:34 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-0f1fb93f-ed6d-4b3b-929d-003b3e99dcf9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:34 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-0f1fb93f-ed6d-4b3b-929d-003b3e99dcf9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024530 Apr 13 15:03:34 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 15:03:34 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:03:36 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7947dde8-2636-4e76-93a7-d55c04593e2b admin admin] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:03:36 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7947dde8-2636-4e76-93a7-d55c04593e2b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001406 Apr 13 15:03:36 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 15:03:36 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:03:36 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-2b7eda62-d1f1-4d12-a44a-4ef73066aeb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "vcpus": 4, "ram": 8192, "swap": 0, "id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:36 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-2b7eda62-d1f1-4d12-a44a-4ef73066aeb0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.069830 Apr 13 15:03:36 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 15:03:36 2023] POST /compute/v2.1/flavors => generated 403 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:03:36 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-cfe79445-4128-4e92-87b8-2e3934e6abd1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:36 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-cfe79445-4128-4e92-87b8-2e3934e6abd1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024243 Apr 13 15:03:36 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 15:03:36 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:03:38 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7947dde8-2636-4e76-93a7-d55c04593e2b admin admin] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:03:38 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7947dde8-2636-4e76-93a7-d55c04593e2b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002334 Apr 13 15:03:38 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 15:03:38 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:03:38 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-01b9fd2b-932e-45d9-9b8d-74a32c1fe615 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "name": "m1.xlarge", "disk": 160, "vcpus": 8, "id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:38 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-01b9fd2b-932e-45d9-9b8d-74a32c1fe615 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.110357 Apr 13 15:03:38 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 15:03:38 2023] POST /compute/v2.1/flavors => generated 406 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:03:38 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-d3cf9253-ad7f-4953-a0dc-c3ff22ece86f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:03:38 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-d3cf9253-ad7f-4953-a0dc-c3ff22ece86f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023730 Apr 13 15:03:38 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 15:03:38 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:04:10 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7947dde8-2636-4e76-93a7-d55c04593e2b admin admin] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:04:10 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7947dde8-2636-4e76-93a7-d55c04593e2b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001416 Apr 13 15:04:10 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 15:04:10 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:04:10 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:04:10 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-98eeeaf2-6b20-4c0f-bbc6-65ed6ca4cafe admin admin] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:04:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-98eeeaf2-6b20-4c0f-bbc6-65ed6ca4cafe admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:04:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-98eeeaf2-6b20-4c0f-bbc6-65ed6ca4cafe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:04:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-98eeeaf2-6b20-4c0f-bbc6-65ed6ca4cafe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:04:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-98eeeaf2-6b20-4c0f-bbc6-65ed6ca4cafe admin admin] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:04:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-98eeeaf2-6b20-4c0f-bbc6-65ed6ca4cafe admin admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:04:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-98eeeaf2-6b20-4c0f-bbc6-65ed6ca4cafe admin admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:04:10 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-98eeeaf2-6b20-4c0f-bbc6-65ed6ca4cafe admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.112797 Apr 13 15:04:10 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Thu Apr 13 15:04:10 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:04:42 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-d3cf9253-ad7f-4953-a0dc-c3ff22ece86f admin admin] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:04:42 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-d3cf9253-ad7f-4953-a0dc-c3ff22ece86f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001535 Apr 13 15:04:42 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 15:04:42 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:04:42 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:04:42 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-a9cbc29e-4feb-419a-9864-da8f2b401be0 admin admin] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:04:42 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-a9cbc29e-4feb-419a-9864-da8f2b401be0 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.082878 Apr 13 15:04:42 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Thu Apr 13 15:04:42 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:04:46 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-98eeeaf2-6b20-4c0f-bbc6-65ed6ca4cafe admin admin] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:04:46 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-98eeeaf2-6b20-4c0f-bbc6-65ed6ca4cafe admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001758 Apr 13 15:04:46 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 15:04:46 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:04:46 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:04:46 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-87bbce1e-5016-43c0-bccd-2e41b2083251 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "ram": 128, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "42", "name": "m1.nano", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:04:46 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-87bbce1e-5016-43c0-bccd-2e41b2083251 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.067243 Apr 13 15:04:46 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 13 15:04:46 2023] POST /compute/v2.1/flavors => generated 403 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:04:46 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-4761c6f5-061e-4247-b535-e6a322ed8f45 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:04:46 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-4761c6f5-061e-4247-b535-e6a322ed8f45 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027649 Apr 13 15:04:46 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 13 15:04:46 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:04:50 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-98eeeaf2-6b20-4c0f-bbc6-65ed6ca4cafe admin admin] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:04:50 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-98eeeaf2-6b20-4c0f-bbc6-65ed6ca4cafe admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001690 Apr 13 15:04:50 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 15:04:50 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:04:50 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-a98c67a5-9448-4139-8c9a-3096f85d13ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "84", "ram": 192, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.micro", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "swap": 0}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:04:50 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-a98c67a5-9448-4139-8c9a-3096f85d13ea admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.059639 Apr 13 15:04:50 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 13 15:04:50 2023] POST /compute/v2.1/flavors => generated 404 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:04:50 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-74caafdc-827e-452c-9402-9067e7b79e61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:04:50 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-74caafdc-827e-452c-9402-9067e7b79e61 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025378 Apr 13 15:04:50 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 13 15:04:50 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:07:03 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:07:03 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:07:03 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=4 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:07:04 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-56e636fa-d361-4afc-bec1-46d4ee5cacf0 tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] Action: 'create', calling method: .version_select at 0x7f3a90cdbeb0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-94286957", "metadata": {"Type": "work"}}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:05 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-56e636fa-d361-4afc-bec1-46d4ee5cacf0 tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 1.964190 Apr 13 15:07:05 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 15:07:03 2023] POST /compute/v2.1/os-volumes => generated 351 bytes in 1966 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 13 15:07:05 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:07:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-ce229e6c-48aa-4a8c-953a-482b093adc98 tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] Calling method '.version_select at 0x7f3a909030a0>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:06 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-ce229e6c-48aa-4a8c-953a-482b093adc98 tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ec8f262f-3646-4a2e-b13b-d2771957671a" status: 200 len: 351 microversion: 2.1 time: 0.592575 Apr 13 15:07:06 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 15:07:05 2023] GET /compute/v2.1/os-volumes/ec8f262f-3646-4a2e-b13b-d2771957671a => generated 351 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:07 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:07:07 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-924b308c-e0af-4fdf-93f0-4fc9091f17d9 tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] Calling method '.version_select at 0x7f3a90a7ae60>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:07 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-924b308c-e0af-4fdf-93f0-4fc9091f17d9 tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ec8f262f-3646-4a2e-b13b-d2771957671a" status: 200 len: 352 microversion: 2.1 time: 0.278841 Apr 13 15:07:07 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 15:07:07 2023] GET /compute/v2.1/os-volumes/ec8f262f-3646-4a2e-b13b-d2771957671a => generated 352 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:07 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-aa448a5d-c525-4f12-8bf0-37b16c99e85a tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] Calling method '.version_select at 0x7f3a9097aa70>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:07 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-aa448a5d-c525-4f12-8bf0-37b16c99e85a tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ec8f262f-3646-4a2e-b13b-d2771957671a" status: 200 len: 352 microversion: 2.1 time: 0.055139 Apr 13 15:07:07 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 15:07:07 2023] GET /compute/v2.1/os-volumes/ec8f262f-3646-4a2e-b13b-d2771957671a => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:07 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-04feff0d-6223-422f-9271-23929d3d81e3 tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] Calling method '.version_select at 0x7f3a909a69e0>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:07 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-04feff0d-6223-422f-9271-23929d3d81e3 tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/ec8f262f-3646-4a2e-b13b-d2771957671a" status: 202 len: 0 microversion: 2.1 time: 0.079163 Apr 13 15:07:07 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 15:07:07 2023] DELETE /compute/v2.1/os-volumes/ec8f262f-3646-4a2e-b13b-d2771957671a => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:07:07 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-9949fde4-776e-4b14-bffb-f00d9ba7a623 tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] Calling method '.version_select at 0x7f3a9091add0>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:07 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-9949fde4-776e-4b14-bffb-f00d9ba7a623 tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ec8f262f-3646-4a2e-b13b-d2771957671a" status: 200 len: 351 microversion: 2.1 time: 0.079226 Apr 13 15:07:07 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 15:07:07 2023] GET /compute/v2.1/os-volumes/ec8f262f-3646-4a2e-b13b-d2771957671a => generated 351 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:08 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-69823ef0-7df6-45ab-8222-36e635290dcc tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] Calling method '.version_select at 0x7f3a9097ac20>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:08 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-69823ef0-7df6-45ab-8222-36e635290dcc tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ec8f262f-3646-4a2e-b13b-d2771957671a" status: 200 len: 351 microversion: 2.1 time: 0.056216 Apr 13 15:07:08 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 15:07:08 2023] GET /compute/v2.1/os-volumes/ec8f262f-3646-4a2e-b13b-d2771957671a => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:07:10 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-470ab0ed-1e45-4d4d-b42e-2162a356b280 tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] Calling method '.version_select at 0x7f3a909a70a0>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:10 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-470ab0ed-1e45-4d4d-b42e-2162a356b280 tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ec8f262f-3646-4a2e-b13b-d2771957671a" status: 200 len: 351 microversion: 2.1 time: 0.111319 Apr 13 15:07:10 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 15:07:09 2023] GET /compute/v2.1/os-volumes/ec8f262f-3646-4a2e-b13b-d2771957671a => generated 351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:11 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-a4a8b62f-37bc-4a0f-a55a-55847cbb154f tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] Calling method '.version_select at 0x7f3a9091b490>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:11 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-a4a8b62f-37bc-4a0f-a55a-55847cbb154f tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ec8f262f-3646-4a2e-b13b-d2771957671a" status: 200 len: 351 microversion: 2.1 time: 0.058757 Apr 13 15:07:11 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 15:07:11 2023] GET /compute/v2.1/os-volumes/ec8f262f-3646-4a2e-b13b-d2771957671a => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:12 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e8b99abf-5934-4817-94ae-ff0c9b7a3e0d tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] Calling method '.version_select at 0x7f3a9097b1c0>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:12 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-e8b99abf-5934-4817-94ae-ff0c9b7a3e0d tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] HTTP exception thrown: Volume ec8f262f-3646-4a2e-b13b-d2771957671a could not be found. Apr 13 15:07:12 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e8b99abf-5934-4817-94ae-ff0c9b7a3e0d tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] Request method failure captured: Apr 13 15:07:12 user devstack@n-api.service[61872]: request: GET /compute/v2.1/os-volumes/ec8f262f-3646-4a2e-b13b-d2771957671a HTTP/1.1 Apr 13 15:07:12 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:07:12 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:07:12 user devstack@n-api.service[61872]: Connection: close Apr 13 15:07:12 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:07:12 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:07:12 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:07:12 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:07:12 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:07:12 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBqXorSc7YHthJcJTVMCVv709h64yzU_7N1UQcChofX_dkugTPgPJiYxwIYwQB2ryS1BP5O1gqGK7vJfUmFspGD3dMKqOJ65uF3yAH1lz94c_570d9jEsHNc1OeQ7l7mppc7b1mDphhGx9YARsvqMK51DGY8N_R4maZMkkdpYtAZhag Apr 13 15:07:12 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:07:12 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:07:12 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:07:12 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:07:12 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:07:12 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:07:12 user devstack@n-api.service[61872]: X-Project-Id: 4e6d40add4584810a79986609c1d20d4 Apr 13 15:07:12 user devstack@n-api.service[61872]: X-Project-Name: tempest-VolumesGetTestJSON-1408680799 Apr 13 15:07:12 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:07:12 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:07:12 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4e6d40add4584810a79986609c1d20d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4e6d40add4584810a79986609c1d20d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4e6d40add4584810a79986609c1d20d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:07:12 user devstack@n-api.service[61872]: X-Tenant: tempest-VolumesGetTestJSON-1408680799 Apr 13 15:07:12 user devstack@n-api.service[61872]: X-Tenant-Id: 4e6d40add4584810a79986609c1d20d4 Apr 13 15:07:12 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-VolumesGetTestJSON-1408680799 Apr 13 15:07:12 user devstack@n-api.service[61872]: X-User: tempest-VolumesGetTestJSON-1408680799-project-member Apr 13 15:07:12 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:07:12 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:07:12 user devstack@n-api.service[61872]: X-User-Id: 0700cff9db6b4dc8b676e6845c479def Apr 13 15:07:12 user devstack@n-api.service[61872]: X-User-Name: tempest-VolumesGetTestJSON-1408680799-project-member Apr 13 15:07:12 user devstack@n-api.service[61872]: method: Apr 13 15:07:12 user devstack@n-api.service[61872]: exception: Volume ec8f262f-3646-4a2e-b13b-d2771957671a could not be found. Apr 13 15:07:12 user devstack@n-api.service[61872]: action_args: {'id': 'ec8f262f-3646-4a2e-b13b-d2771957671a'} Apr 13 15:07:12 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ec8f262f-3646-4a2e-b13b-d2771957671a could not be found. (HTTP 404) (Request-ID: req-46da0a42-3a7c-49e3-ad0e-014fdbde9b6d) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ec8f262f-3646-4a2e-b13b-d2771957671a could not be found. Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ec8f262f-3646-4a2e-b13b-d2771957671a could not be found. Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ec8f262f-3646-4a2e-b13b-d2771957671a could not be found. Apr 13 15:07:12 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:07:12 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e8b99abf-5934-4817-94ae-ff0c9b7a3e0d tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] Returning 404 to user: Volume ec8f262f-3646-4a2e-b13b-d2771957671a could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:07:12 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-e8b99abf-5934-4817-94ae-ff0c9b7a3e0d tempest-VolumesGetTestJSON-1408680799 tempest-VolumesGetTestJSON-1408680799-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ec8f262f-3646-4a2e-b13b-d2771957671a" status: 404 len: 109 microversion: 2.1 time: 0.053223 Apr 13 15:07:12 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 15:07:12 2023] GET /compute/v2.1/os-volumes/ec8f262f-3646-4a2e-b13b-d2771957671a => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:07:17 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-af8df641-6064-465f-a4a7-b7513f7c49ea tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] Calling method '.version_select at 0x7f3a909a7370>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:17 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-af8df641-6064-465f-a4a7-b7513f7c49ea tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6d645b9c-a662-4f1c-af64-29a75e1a6f2a" status: 200 len: 349 microversion: 2.1 time: 0.048050 Apr 13 15:07:17 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 15:07:17 2023] GET /compute/v2.1/os-volumes/6d645b9c-a662-4f1c-af64-29a75e1a6f2a => generated 349 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:18 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-2ce87c65-5742-4e92-9c9f-282ea6a25935 tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] Calling method '.version_select at 0x7f3a9091b880>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:18 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-2ce87c65-5742-4e92-9c9f-282ea6a25935 tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/cbdfb75f-208a-4bef-b384-eb8f662d1291" status: 200 len: 350 microversion: 2.1 time: 0.061033 Apr 13 15:07:18 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 15:07:18 2023] GET /compute/v2.1/os-volumes/cbdfb75f-208a-4bef-b384-eb8f662d1291 => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:20 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-1aa86cbd-3848-4aa7-966a-b9aa66be6dc8 tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] Calling method '.version_select at 0x7f3a909ec280>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:20 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-1aa86cbd-3848-4aa7-966a-b9aa66be6dc8 tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c7d13ad5-b99e-4d14-ad7b-e93e20ff8b8f" status: 200 len: 350 microversion: 2.1 time: 0.063890 Apr 13 15:07:20 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 15:07:20 2023] GET /compute/v2.1/os-volumes/c7d13ad5-b99e-4d14-ad7b-e93e20ff8b8f => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:20 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-70c7c69c-1374-42a9-9573-5a31282439b3 tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] Calling method '.version_select at 0x7f3a909a6b00>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:20 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-70c7c69c-1374-42a9-9573-5a31282439b3 tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.083135 Apr 13 15:07:20 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 21/59] 10.0.0.210 () {62 vars in 1211 bytes} [Thu Apr 13 15:07:20 2023] GET /compute/v2.1/os-volumes => generated 1032 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:07:20 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-5d5c4200-937e-4591-8662-391e27b3a74f tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] Calling method '.version_select at 0x7f3a9091b130>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:20 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-5d5c4200-937e-4591-8662-391e27b3a74f tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.102325 Apr 13 15:07:20 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 20/60] 10.0.0.210 () {62 vars in 1226 bytes} [Thu Apr 13 15:07:20 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:20 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-b036f04f-9321-4309-91a6-a28715e60f6e tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] Calling method '.version_select at 0x7f3a909ec8b0>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:20 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-b036f04f-9321-4309-91a6-a28715e60f6e tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.120465 Apr 13 15:07:20 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 20/61] 10.0.0.210 () {62 vars in 1211 bytes} [Thu Apr 13 15:07:20 2023] GET /compute/v2.1/os-volumes => generated 1032 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:07:20 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-32123b0d-9003-4e1b-b12b-6b2108c9a547 tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] Calling method '.version_select at 0x7f3a909b4310>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:20 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-32123b0d-9003-4e1b-b12b-6b2108c9a547 tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.122233 Apr 13 15:07:20 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 22/62] 10.0.0.210 () {62 vars in 1244 bytes} [Thu Apr 13 15:07:20 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:20 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-baa47612-97f3-41cb-88b8-f143ce90ba34 tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] Calling method '.version_select at 0x7f3a90928790>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:20 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-baa47612-97f3-41cb-88b8-f143ce90ba34 tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.094535 Apr 13 15:07:20 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 21/63] 10.0.0.210 () {62 vars in 1247 bytes} [Thu Apr 13 15:07:20 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:20 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-ae45b2e9-7f48-4000-bf13-2f291e349be1 tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] Calling method '.version_select at 0x7f3a909ed750>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:20 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-ae45b2e9-7f48-4000-bf13-2f291e349be1 tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.117954 Apr 13 15:07:20 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 21/64] 10.0.0.210 () {62 vars in 1232 bytes} [Thu Apr 13 15:07:20 2023] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:07:20 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-9162788f-d5fe-4c66-906b-87b48b1beb2c tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] Calling method '.version_select at 0x7f3a909a6a70>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:20 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-9162788f-d5fe-4c66-906b-87b48b1beb2c tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.105812 Apr 13 15:07:20 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 23/65] 10.0.0.210 () {62 vars in 1265 bytes} [Thu Apr 13 15:07:20 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:20 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-ee95913f-7d2a-40c4-adc5-2eb50917b80c tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] Calling method '.version_select at 0x7f3a9091b370>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:21 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-ee95913f-7d2a-40c4-adc5-2eb50917b80c tempest-VolumesTestJSON-1949757733 tempest-VolumesTestJSON-1949757733-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.086236 Apr 13 15:07:21 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 22/66] 10.0.0.210 () {62 vars in 1232 bytes} [Thu Apr 13 15:07:20 2023] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:07:21 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-282341879", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "networks": [{"uuid": "1f3dba00-8e14-4683-8d13-ebc5e4395913"}]}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:21 user devstack@n-api.service[61872]: DEBUG nova.network.neutron [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] validate_networks() for [('1f3dba00-8e14-4683-8d13-ebc5e4395913', None, None, None, None, None)] {{(pid=61872) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:07:24 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Flavor limits 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:07:24 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Image limits 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:07:24 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Flavor pref 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:07:24 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Image pref 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:07:24 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:07:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:24 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Getting quotas for project 62589c1782f2473ead9b4270af3982f6. Resources: {'cores', 'instances', 'ram'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:07:24 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Getting quotas for user 2844897ef27d4395af0a8f069699ce4d and project 62589c1782f2473ead9b4270af3982f6. Resources: {'cores', 'instances', 'ram'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:07:24 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Going to run 1 instances... {{(pid=61872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:07:24 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:07:24 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.896853 Apr 13 15:07:24 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 22/67] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:07:21 2023] POST /compute/v2.1/servers => generated 378 bytes in 2899 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:07:24 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-4be3f02e-e610-4413-964a-722016556c59 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:24 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-4be3f02e-e610-4413-964a-722016556c59 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:07:24 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-848115608", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:24 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-4be3f02e-e610-4413-964a-722016556c59 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844897ef27d4395af0a8f069699ce4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62589c1782f2473ead9b4270af3982f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:07:24 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-4be3f02e-e610-4413-964a-722016556c59 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5" status: 200 len: 1208 microversion: 2.1 time: 0.344397 Apr 13 15:07:24 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 24/68] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:07:24 2023] GET /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5 => generated 1208 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:07:24 user devstack@n-api.service[61873]: DEBUG nova.network.neutron [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] validate_networks() for [('434a74f0-0d97-44db-bbc8-2c5b3599caab', None, None, None, None, None)] {{(pid=61873) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:07:25 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Flavor limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:07:25 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Image limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:07:25 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Flavor pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:07:25 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Image pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:07:25 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:07:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:25 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Getting quotas for project 9bad96fcfa0d4691af2a7990ba9dbd09. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:07:25 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Getting quotas for user c83940ddaaf64d94b40df9d00349aa91 and project 9bad96fcfa0d4691af2a7990ba9dbd09. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:07:25 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Going to run 1 instances... {{(pid=61873) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:07:25 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:07:25 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.079299 Apr 13 15:07:25 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 23/69] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:07:24 2023] POST /compute/v2.1/servers => generated 381 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 13 15:07:25 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-ccd8a9df-04f2-45c8-b6e7-9ed8be2dd342 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:25 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-ccd8a9df-04f2-45c8-b6e7-9ed8be2dd342 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:07:25 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-ccd8a9df-04f2-45c8-b6e7-9ed8be2dd342 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:07:25 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-ccd8a9df-04f2-45c8-b6e7-9ed8be2dd342 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653" status: 200 len: 1215 microversion: 2.1 time: 0.184738 Apr 13 15:07:25 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 23/70] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:07:25 2023] GET /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653 => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:07:25 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-842194501", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:26 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] validate_networks() for [('434a74f0-0d97-44db-bbc8-2c5b3599caab', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:07:28 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:07:28 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:07:28 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:07:28 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:07:28 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:07:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:28 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Getting quotas for project 9bad96fcfa0d4691af2a7990ba9dbd09. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:07:28 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Getting quotas for user c83940ddaaf64d94b40df9d00349aa91 and project 9bad96fcfa0d4691af2a7990ba9dbd09. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:07:28 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:07:28 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:07:28 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.728283 Apr 13 15:07:28 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 25/71] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:07:25 2023] POST /compute/v2.1/servers => generated 381 bytes in 2731 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:07:28 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-8e227bc8-e65b-463c-8d96-0dc05b76302c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:28 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-8e227bc8-e65b-463c-8d96-0dc05b76302c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:07:28 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-8e227bc8-e65b-463c-8d96-0dc05b76302c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:07:28 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-8e227bc8-e65b-463c-8d96-0dc05b76302c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25f57234-8818-44d3-b476-d6cfba7b2810" status: 200 len: 1215 microversion: 2.1 time: 0.164019 Apr 13 15:07:28 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 24/72] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:07:28 2023] GET /compute/v2.1/servers/25f57234-8818-44d3-b476-d6cfba7b2810 => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:07:29 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-4b515363-838b-4042-9163-f8ee9f7ae263 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Action: 'create', calling method: .version_select at 0x7f3a908ab9a0>, body: {"keypair": {"name": "tempest-keypair-135051856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6aSZKMD7DZRWnRyQAYKNVncY9MliP5yy+hr0mgok5IZOsUvvcpOVyIYwqoPxDEzOUN1HvhtDQMVs5WOR8xHMOt96WLfesTfqwvy1g4TGHpkWUPIHKMkqgOoitvtlLAkg=="}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:29 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-4b515363-838b-4042-9163-f8ee9f7ae263 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Getting quotas for project b5acb52755c74d118d012e38feed7237. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:07:29 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-4b515363-838b-4042-9163-f8ee9f7ae263 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Getting quotas for user b30a69b780664742aed58bd9a578e873 and project b5acb52755c74d118d012e38feed7237. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:07:29 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-4b515363-838b-4042-9163-f8ee9f7ae263 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.231880 Apr 13 15:07:29 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 24/73] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 15:07:28 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:32 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-464267024", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "networks": [{"uuid": "928c080b-0ead-4f65-85b3-2c98a7549dbb"}]}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:32 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] validate_networks() for [('928c080b-0ead-4f65-85b3-2c98a7549dbb', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:07:33 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-02a20123-45df-463a-b84c-d5b68d8dfc17 req-569cceef-343e-4c24-9abf-2ccc3a46f797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58a0788e-df82-4c1e-97dd-1d246048afc5", "tag": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-02a20123-45df-463a-b84c-d5b68d8dfc17 req-569cceef-343e-4c24-9abf-2ccc3a46f797 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-02a20123-45df-463a-b84c-d5b68d8dfc17 req-569cceef-343e-4c24-9abf-2ccc3a46f797 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-02a20123-45df-463a-b84c-d5b68d8dfc17 req-569cceef-343e-4c24-9abf-2ccc3a46f797 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:33 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-02a20123-45df-463a-b84c-d5b68d8dfc17 req-569cceef-343e-4c24-9abf-2ccc3a46f797 service nova] Creating event network-changed:393596c3-b6ee-4d5e-bec9-d9e96b9bf93f for instance 58a0788e-df82-4c1e-97dd-1d246048afc5 on user Apr 13 15:07:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-02a20123-45df-463a-b84c-d5b68d8dfc17 req-569cceef-343e-4c24-9abf-2ccc3a46f797 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61873) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 15:07:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-02a20123-45df-463a-b84c-d5b68d8dfc17 req-569cceef-343e-4c24-9abf-2ccc3a46f797 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61873) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 15:07:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4e1d6b3e-0376-48bc-b728-43a2513d897a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4e1d6b3e-0376-48bc-b728-43a2513d897a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4e1d6b3e-0376-48bc-b728-43a2513d897a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4e1d6b3e-0376-48bc-b728-43a2513d897a None None] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4e1d6b3e-0376-48bc-b728-43a2513d897a None None] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4e1d6b3e-0376-48bc-b728-43a2513d897a None None] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:33 user devstack@n-api.service[61873]: INFO nova.compute.rpcapi [None req-4e1d6b3e-0376-48bc-b728-43a2513d897a None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 15:07:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4e1d6b3e-0376-48bc-b728-43a2513d897a None None] Releasing lock "compute-rpcapi-router" {{(pid=61873) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 15:07:33 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-4e1d6b3e-0376-48bc-b728-43a2513d897a None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193057 Apr 13 15:07:33 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 25/74] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:07:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:34 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:07:34 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:07:34 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:07:34 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:07:34 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:07:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:34 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Getting quotas for project 240b28f42732478ba732994b2c9e3fbe. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:07:34 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Getting quotas for user 75bf6e19993f4c2e90fd52c4d6212622 and project 240b28f42732478ba732994b2c9e3fbe. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:07:34 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:07:34 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:07:34 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.894449 Apr 13 15:07:34 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 26/75] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 15:07:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 1897 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 15:07:34 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-7ffc234b-422b-41d2-a026-725b0a9d7812 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:34 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-7ffc234b-422b-41d2-a026-725b0a9d7812 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:07:34 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:07:34 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:07:34 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-7ffc234b-422b-41d2-a026-725b0a9d7812 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:07:34 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-7ffc234b-422b-41d2-a026-725b0a9d7812 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:07:34 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-7ffc234b-422b-41d2-a026-725b0a9d7812 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:07:34 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-7ffc234b-422b-41d2-a026-725b0a9d7812 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" status: 200 len: 1394 microversion: 2.87 time: 0.231045 Apr 13 15:07:34 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 25/76] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:07:34 2023] GET /compute/v2.1/servers/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba => generated 1394 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:07:36 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-319d17d7-90cd-4eb6-8caf-b5526bd8dcb5 req-e070ffd0-de26-454a-815c-1f4e82474e61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f54cffe3-73da-468b-8252-b74cb4ba9653", "tag": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-319d17d7-90cd-4eb6-8caf-b5526bd8dcb5 req-e070ffd0-de26-454a-815c-1f4e82474e61 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-319d17d7-90cd-4eb6-8caf-b5526bd8dcb5 req-e070ffd0-de26-454a-815c-1f4e82474e61 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-319d17d7-90cd-4eb6-8caf-b5526bd8dcb5 req-e070ffd0-de26-454a-815c-1f4e82474e61 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:36 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-319d17d7-90cd-4eb6-8caf-b5526bd8dcb5 req-e070ffd0-de26-454a-815c-1f4e82474e61 service nova] Creating event network-changed:0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance f54cffe3-73da-468b-8252-b74cb4ba9653 on user Apr 13 15:07:36 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-319d17d7-90cd-4eb6-8caf-b5526bd8dcb5 req-e070ffd0-de26-454a-815c-1f4e82474e61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143380 Apr 13 15:07:36 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 26/77] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:07:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:36 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1909171132", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "networks": [{"uuid": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c"}], "security_groups": [{"name": "tempest-securitygroup--1026747693"}], "key_name": "tempest-keypair-135051856", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:37 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] validate_networks() for [('1cdb762d-7c09-4d16-bd83-31a75edb8a9c', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:07:37 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-79f57a87-d663-418e-aff8-f68ed8341262 req-a6552358-7016-4e09-b4f8-ed9c49d96420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25f57234-8818-44d3-b476-d6cfba7b2810", "tag": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-79f57a87-d663-418e-aff8-f68ed8341262 req-a6552358-7016-4e09-b4f8-ed9c49d96420 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-79f57a87-d663-418e-aff8-f68ed8341262 req-a6552358-7016-4e09-b4f8-ed9c49d96420 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-79f57a87-d663-418e-aff8-f68ed8341262 req-a6552358-7016-4e09-b4f8-ed9c49d96420 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:37 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-79f57a87-d663-418e-aff8-f68ed8341262 req-a6552358-7016-4e09-b4f8-ed9c49d96420 service nova] Creating event network-changed:e4b886a7-88e3-42e3-98b8-b0fa9d67391a for instance 25f57234-8818-44d3-b476-d6cfba7b2810 on user Apr 13 15:07:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-79f57a87-d663-418e-aff8-f68ed8341262 req-a6552358-7016-4e09-b4f8-ed9c49d96420 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61872) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 15:07:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-79f57a87-d663-418e-aff8-f68ed8341262 req-a6552358-7016-4e09-b4f8-ed9c49d96420 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61872) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 15:07:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5a288476-eae2-4fe0-b1ec-4fffc562c802 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5a288476-eae2-4fe0-b1ec-4fffc562c802 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5a288476-eae2-4fe0-b1ec-4fffc562c802 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5a288476-eae2-4fe0-b1ec-4fffc562c802 None None] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5a288476-eae2-4fe0-b1ec-4fffc562c802 None None] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5a288476-eae2-4fe0-b1ec-4fffc562c802 None None] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:37 user devstack@n-api.service[61872]: INFO nova.compute.rpcapi [None req-5a288476-eae2-4fe0-b1ec-4fffc562c802 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 15:07:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5a288476-eae2-4fe0-b1ec-4fffc562c802 None None] Releasing lock "compute-rpcapi-router" {{(pid=61872) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 15:07:37 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-5a288476-eae2-4fe0-b1ec-4fffc562c802 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149845 Apr 13 15:07:37 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 26/78] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:07:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:38 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:07:38 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:07:38 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:07:38 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:07:38 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:07:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:38 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Getting quotas for project b5acb52755c74d118d012e38feed7237. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:07:38 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Getting quotas for user b30a69b780664742aed58bd9a578e873 and project b5acb52755c74d118d012e38feed7237. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:07:38 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:07:38 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:07:38 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.916604 Apr 13 15:07:38 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 27/79] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:07:36 2023] POST /compute/v2.1/servers => generated 404 bytes in 1919 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:07:38 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-0223e854-91b9-4f4c-825b-e16e10bcdda8 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:38 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-0223e854-91b9-4f4c-825b-e16e10bcdda8 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:07:38 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=8 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:07:38 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-0223e854-91b9-4f4c-825b-e16e10bcdda8 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30a69b780664742aed58bd9a578e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5acb52755c74d118d012e38feed7237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:07:38 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-0223e854-91b9-4f4c-825b-e16e10bcdda8 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818" status: 200 len: 1239 microversion: 2.1 time: 0.139329 Apr 13 15:07:38 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 27/80] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:07:38 2023] GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818 => generated 1239 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:07:40 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-11b8739e-5cdd-44bf-82b7-2fc3825c1df9 req-785e39d3-7c46-476d-a138-a448e55ddcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba", "tag": "e2b989b1-9194-48e5-a3e4-e35566440e3d"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-11b8739e-5cdd-44bf-82b7-2fc3825c1df9 req-785e39d3-7c46-476d-a138-a448e55ddcd0 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-11b8739e-5cdd-44bf-82b7-2fc3825c1df9 req-785e39d3-7c46-476d-a138-a448e55ddcd0 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-11b8739e-5cdd-44bf-82b7-2fc3825c1df9 req-785e39d3-7c46-476d-a138-a448e55ddcd0 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:40 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-11b8739e-5cdd-44bf-82b7-2fc3825c1df9 req-785e39d3-7c46-476d-a138-a448e55ddcd0 service nova] Creating event network-changed:e2b989b1-9194-48e5-a3e4-e35566440e3d for instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba on user Apr 13 15:07:40 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-11b8739e-5cdd-44bf-82b7-2fc3825c1df9 req-785e39d3-7c46-476d-a138-a448e55ddcd0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182321 Apr 13 15:07:40 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 27/81] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:07:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:41 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-75c918c1-c4cb-4575-9dd3-ed9f37aad1db req-1afc5b8e-b156-4f21-8502-18f35920bd1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f54cffe3-73da-468b-8252-b74cb4ba9653", "name": "network-vif-plugged", "status": "completed", "tag": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-75c918c1-c4cb-4575-9dd3-ed9f37aad1db req-1afc5b8e-b156-4f21-8502-18f35920bd1a service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-75c918c1-c4cb-4575-9dd3-ed9f37aad1db req-1afc5b8e-b156-4f21-8502-18f35920bd1a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-75c918c1-c4cb-4575-9dd3-ed9f37aad1db req-1afc5b8e-b156-4f21-8502-18f35920bd1a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:42 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-75c918c1-c4cb-4575-9dd3-ed9f37aad1db req-1afc5b8e-b156-4f21-8502-18f35920bd1a service nova] Creating event network-vif-plugged:0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance f54cffe3-73da-468b-8252-b74cb4ba9653 on user Apr 13 15:07:42 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-75c918c1-c4cb-4575-9dd3-ed9f37aad1db req-1afc5b8e-b156-4f21-8502-18f35920bd1a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61871) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 15:07:42 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-75c918c1-c4cb-4575-9dd3-ed9f37aad1db req-1afc5b8e-b156-4f21-8502-18f35920bd1a service nova] Acquired lock "compute-rpcapi-router" {{(pid=61871) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 15:07:42 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ea2191df-b2c3-486c-9121-77eb262b31b3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:42 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ea2191df-b2c3-486c-9121-77eb262b31b3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:42 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ea2191df-b2c3-486c-9121-77eb262b31b3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:42 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ea2191df-b2c3-486c-9121-77eb262b31b3 None None] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:42 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ea2191df-b2c3-486c-9121-77eb262b31b3 None None] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:42 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ea2191df-b2c3-486c-9121-77eb262b31b3 None None] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:42 user devstack@n-api.service[61871]: INFO nova.compute.rpcapi [None req-ea2191df-b2c3-486c-9121-77eb262b31b3 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 15:07:42 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ea2191df-b2c3-486c-9121-77eb262b31b3 None None] Releasing lock "compute-rpcapi-router" {{(pid=61871) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 15:07:42 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-ea2191df-b2c3-486c-9121-77eb262b31b3 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143969 Apr 13 15:07:42 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 28/82] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:07:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:42 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-508666ef-cec8-4459-b2bd-250f664cce08 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Action: 'create', calling method: .version_select at 0x7f3a8bf31f30>, body: {"keypair": {"name": "tempest-keypair-815100895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdE6pt2CSkI/kEMmDhNZ34i6Ws4BJ7Wxj9caFRRNEIYDhqeJqqwyQIDLqWtH2pzCVO74K73+FxMAYZGQKcysukCtq7qljnX22uMPUb/pbYlx+SVYyeT77SFJp2ybY8vxQ=="}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:42 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-508666ef-cec8-4459-b2bd-250f664cce08 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Getting quotas for project 89fbef55fb3c43d69af48208d28c87f0. Resources: {'key_pairs'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:07:42 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-508666ef-cec8-4459-b2bd-250f664cce08 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Getting quotas for user f6747b03238c481d836caaf583f20a16 and project 89fbef55fb3c43d69af48208d28c87f0. Resources: {'key_pairs'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:07:42 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-508666ef-cec8-4459-b2bd-250f664cce08 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.311123 Apr 13 15:07:42 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 28/83] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 15:07:42 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:42 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-68751c19-f6b5-4974-bba4-51e73c740640 req-ebd486f1-368b-491f-8595-9c8d467fdbd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a0788e-df82-4c1e-97dd-1d246048afc5", "name": "network-vif-plugged", "status": "completed", "tag": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:42 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-68751c19-f6b5-4974-bba4-51e73c740640 req-ebd486f1-368b-491f-8595-9c8d467fdbd9 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:42 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-68751c19-f6b5-4974-bba4-51e73c740640 req-ebd486f1-368b-491f-8595-9c8d467fdbd9 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:42 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-68751c19-f6b5-4974-bba4-51e73c740640 req-ebd486f1-368b-491f-8595-9c8d467fdbd9 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:42 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-68751c19-f6b5-4974-bba4-51e73c740640 req-ebd486f1-368b-491f-8595-9c8d467fdbd9 service nova] Creating event network-vif-plugged:393596c3-b6ee-4d5e-bec9-d9e96b9bf93f for instance 58a0788e-df82-4c1e-97dd-1d246048afc5 on user Apr 13 15:07:42 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-68751c19-f6b5-4974-bba4-51e73c740640 req-ebd486f1-368b-491f-8595-9c8d467fdbd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036427 Apr 13 15:07:42 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 28/84] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:07:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:44 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-bfe591b6-718e-4931-b7f3-92631310902f req-e7272171-9cb7-4b98-8555-c56178901d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f54cffe3-73da-468b-8252-b74cb4ba9653", "name": "network-vif-plugged", "status": "completed", "tag": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d"}, {"server_uuid": "25f57234-8818-44d3-b476-d6cfba7b2810", "name": "network-vif-plugged", "status": "completed", "tag": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-bfe591b6-718e-4931-b7f3-92631310902f req-e7272171-9cb7-4b98-8555-c56178901d51 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-bfe591b6-718e-4931-b7f3-92631310902f req-e7272171-9cb7-4b98-8555-c56178901d51 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-bfe591b6-718e-4931-b7f3-92631310902f req-e7272171-9cb7-4b98-8555-c56178901d51 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:44 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-bfe591b6-718e-4931-b7f3-92631310902f req-e7272171-9cb7-4b98-8555-c56178901d51 service nova] Creating event network-vif-plugged:0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance f54cffe3-73da-468b-8252-b74cb4ba9653 on user Apr 13 15:07:44 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-bfe591b6-718e-4931-b7f3-92631310902f req-e7272171-9cb7-4b98-8555-c56178901d51 service nova] Creating event network-vif-plugged:e4b886a7-88e3-42e3-98b8-b0fa9d67391a for instance 25f57234-8818-44d3-b476-d6cfba7b2810 on user Apr 13 15:07:44 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-bfe591b6-718e-4931-b7f3-92631310902f req-e7272171-9cb7-4b98-8555-c56178901d51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041393 Apr 13 15:07:44 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 29/85] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:07:44 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:44 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:07:44 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-c53eab12-c4f7-46f9-a238-2b0a11736bc2 req-b61fc33a-f335-4d28-99e3-6893c8026e2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a0788e-df82-4c1e-97dd-1d246048afc5", "name": "network-vif-plugged", "status": "completed", "tag": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:44 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c53eab12-c4f7-46f9-a238-2b0a11736bc2 req-b61fc33a-f335-4d28-99e3-6893c8026e2f service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:44 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c53eab12-c4f7-46f9-a238-2b0a11736bc2 req-b61fc33a-f335-4d28-99e3-6893c8026e2f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:44 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c53eab12-c4f7-46f9-a238-2b0a11736bc2 req-b61fc33a-f335-4d28-99e3-6893c8026e2f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:44 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-c53eab12-c4f7-46f9-a238-2b0a11736bc2 req-b61fc33a-f335-4d28-99e3-6893c8026e2f service nova] Creating event network-vif-plugged:393596c3-b6ee-4d5e-bec9-d9e96b9bf93f for instance 58a0788e-df82-4c1e-97dd-1d246048afc5 on user Apr 13 15:07:44 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-c53eab12-c4f7-46f9-a238-2b0a11736bc2 req-b61fc33a-f335-4d28-99e3-6893c8026e2f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088676 Apr 13 15:07:44 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 29/86] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:07:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:46 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=14 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:07:46 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f57234-8818-44d3-b476-d6cfba7b2810", "name": "network-vif-plugged", "status": "completed", "tag": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a"}, {"name": "network-changed", "server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:46 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] Creating event network-vif-plugged:e4b886a7-88e3-42e3-98b8-b0fa9d67391a for instance 25f57234-8818-44d3-b476-d6cfba7b2810 on user Apr 13 15:07:46 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] Creating event network-changed:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:07:46 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.102150 Apr 13 15:07:46 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 29/87] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:07:46 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:46 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-8b06b10c-f082-46f9-a73e-48857d10b0fd req-686b92f9-8e3a-4c56-a70a-776a1dec8e37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba", "name": "network-vif-plugged", "status": "completed", "tag": "e2b989b1-9194-48e5-a3e4-e35566440e3d"}, {"server_uuid": "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba", "name": "network-vif-plugged", "status": "completed", "tag": "e2b989b1-9194-48e5-a3e4-e35566440e3d"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-8b06b10c-f082-46f9-a73e-48857d10b0fd req-686b92f9-8e3a-4c56-a70a-776a1dec8e37 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-8b06b10c-f082-46f9-a73e-48857d10b0fd req-686b92f9-8e3a-4c56-a70a-776a1dec8e37 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-8b06b10c-f082-46f9-a73e-48857d10b0fd req-686b92f9-8e3a-4c56-a70a-776a1dec8e37 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:46 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-8b06b10c-f082-46f9-a73e-48857d10b0fd req-686b92f9-8e3a-4c56-a70a-776a1dec8e37 service nova] Creating event network-vif-plugged:e2b989b1-9194-48e5-a3e4-e35566440e3d for instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba on user Apr 13 15:07:46 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-8b06b10c-f082-46f9-a73e-48857d10b0fd req-686b92f9-8e3a-4c56-a70a-776a1dec8e37 service nova] Creating event network-vif-plugged:e2b989b1-9194-48e5-a3e4-e35566440e3d for instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba on user Apr 13 15:07:46 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-8b06b10c-f082-46f9-a73e-48857d10b0fd req-686b92f9-8e3a-4c56-a70a-776a1dec8e37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.102292 Apr 13 15:07:46 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 30/88] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:07:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:50 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-63d5b249-0000-4f7b-bc0c-a582dd023c94 req-0152f065-d4fa-4e7a-b72a-79b828306f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "name": "network-vif-plugged", "status": "completed", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:50 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:07:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-63d5b249-0000-4f7b-bc0c-a582dd023c94 req-0152f065-d4fa-4e7a-b72a-79b828306f2e service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-63d5b249-0000-4f7b-bc0c-a582dd023c94 req-0152f065-d4fa-4e7a-b72a-79b828306f2e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-63d5b249-0000-4f7b-bc0c-a582dd023c94 req-0152f065-d4fa-4e7a-b72a-79b828306f2e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:50 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=11 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:07:50 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-63d5b249-0000-4f7b-bc0c-a582dd023c94 req-0152f065-d4fa-4e7a-b72a-79b828306f2e service nova] Creating event network-vif-plugged:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:07:50 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-63d5b249-0000-4f7b-bc0c-a582dd023c94 req-0152f065-d4fa-4e7a-b72a-79b828306f2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123234 Apr 13 15:07:50 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 30/89] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:07:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:51 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:07:51 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-147617088", "imageRef": "1b4e800e-2bfa-417d-a618-befe946371e7", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "c4a62646-4713-4fec-aef2-21b4c00c534f"}], "security_groups": [{"name": "tempest-securitygroup--838930132"}], "key_name": "tempest-keypair-815100895", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:51 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:07:52 user devstack@n-api.service[61872]: DEBUG nova.network.neutron [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] validate_networks() for [('c4a62646-4713-4fec-aef2-21b4c00c534f', None, None, None, None, None)] {{(pid=61872) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:07:52 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=20 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:07:52 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=8 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:07:52 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-60deaa1f-6ec7-4edd-9805-f34f3cd0c79d tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Action: 'create', calling method: .version_select at 0x7f3a908afd90>, body: {"keypair": {"name": "tempest-keypair-38678878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7UiZBBPqbMTDNeH6e75E+1q+0ruGAE6pDAnPOoJW7nq6PcivT2tcES9p9mrLu8hWYaw2+Sm3p5lwGbApOi6N4MWBvGgfhOCip/2hL91LC4ATNbe75oeKHbSqHKlX+mxA=="}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:52 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-c2876e72-243f-40d4-b512-784094baee36 req-77ffb579-d971-47d6-8989-b0bd4ff95803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "name": "network-vif-plugged", "status": "completed", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:52 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=9 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:07:52 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c2876e72-243f-40d4-b512-784094baee36 req-77ffb579-d971-47d6-8989-b0bd4ff95803 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:52 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c2876e72-243f-40d4-b512-784094baee36 req-77ffb579-d971-47d6-8989-b0bd4ff95803 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:52 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c2876e72-243f-40d4-b512-784094baee36 req-77ffb579-d971-47d6-8989-b0bd4ff95803 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:52 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-c2876e72-243f-40d4-b512-784094baee36 req-77ffb579-d971-47d6-8989-b0bd4ff95803 service nova] Creating event network-vif-plugged:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:07:52 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:07:52 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-60deaa1f-6ec7-4edd-9805-f34f3cd0c79d tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Getting quotas for project 8f7b81912360422a8413f8760b0cf7e1. Resources: {'key_pairs'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:07:52 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-c2876e72-243f-40d4-b512-784094baee36 req-77ffb579-d971-47d6-8989-b0bd4ff95803 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100723 Apr 13 15:07:52 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 31/90] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:07:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:52 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-60deaa1f-6ec7-4edd-9805-f34f3cd0c79d tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Getting quotas for user 54b07929cf2c404ab10ce944437e9e97 and project 8f7b81912360422a8413f8760b0cf7e1. Resources: {'key_pairs'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:07:52 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1168002149", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:52 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-60deaa1f-6ec7-4edd-9805-f34f3cd0c79d tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.626844 Apr 13 15:07:52 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 31/91] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 15:07:52 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:52 user devstack@n-api.service[61873]: DEBUG nova.network.neutron [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] validate_networks() for None {{(pid=61873) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:07:53 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Flavor limits 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:07:53 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Image limits 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:07:53 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Flavor pref 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:07:53 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Image pref 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:07:53 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:07:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:53 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Getting quotas for project 89fbef55fb3c43d69af48208d28c87f0. Resources: {'cores', 'instances', 'ram'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:07:53 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Getting quotas for user f6747b03238c481d836caaf583f20a16 and project 89fbef55fb3c43d69af48208d28c87f0. Resources: {'cores', 'instances', 'ram'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:07:53 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Going to run 1 instances... {{(pid=61872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:07:53 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1b4e800e-2bfa-417d-a618-befe946371e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:07:53 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Flavor limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:07:53 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Image limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:07:53 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Flavor pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:07:53 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Image pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:07:53 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:07:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:53 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Getting quotas for project 51c1b992977a479883e445330b3d0d97. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:07:53 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.805804 Apr 13 15:07:53 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 30/92] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:07:51 2023] POST /compute/v2.1/servers => generated 403 bytes in 1810 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:07:53 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Getting quotas for user e8adc8b289e548a5ac16b6356753d6dc and project 51c1b992977a479883e445330b3d0d97. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:07:53 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-ecb115b5-d6e4-4de2-8e70-8bccf01b54a7 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:53 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-ecb115b5-d6e4-4de2-8e70-8bccf01b54a7 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:07:53 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Going to run 1 instances... {{(pid=61873) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:07:53 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:07:53 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.865798 Apr 13 15:07:53 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 32/93] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:07:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:07:53 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-19f2d10e-2c35-4b48-acc9-ae7a36b07b0a tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:53 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-19f2d10e-2c35-4b48-acc9-ae7a36b07b0a tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:07:53 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-19f2d10e-2c35-4b48-acc9-ae7a36b07b0a tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8adc8b289e548a5ac16b6356753d6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c1b992977a479883e445330b3d0d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:07:53 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-19f2d10e-2c35-4b48-acc9-ae7a36b07b0a tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] 10.0.0.210 "GET /compute/v2.1/servers/63f69337-7ae4-4125-a560-f6cbcb2298d4" status: 200 len: 1209 microversion: 2.1 time: 0.141816 Apr 13 15:07:53 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 31/94] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:07:53 2023] GET /compute/v2.1/servers/63f69337-7ae4-4125-a560-f6cbcb2298d4 => generated 1209 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:07:53 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-ecb115b5-d6e4-4de2-8e70-8bccf01b54a7 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6747b03238c481d836caaf583f20a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fbef55fb3c43d69af48208d28c87f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:07:53 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-ecb115b5-d6e4-4de2-8e70-8bccf01b54a7 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9" status: 200 len: 1238 microversion: 2.1 time: 0.312044 Apr 13 15:07:53 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 32/95] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:07:53 2023] GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9 => generated 1238 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:07:57 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-464e9263-b7c0-4b97-b05c-339a1b4f4b5f tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Action: 'create', calling method: .version_select at 0x7f3a8bf33130>, body: {"keypair": {"name": "tempest-keypair-207135700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxaPFHAbqgKO/COFA+DY9rzW2J06VevHnbo6RHC30lfgxcW4Tr0/A0vkvfKOugPt7bpUnVxbSJNj1OF4CitPIV1KK3jFhN1Gew1EBCLK64eY9o49B6MR8/BFPl6+1JP9Q=="}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:57 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-464e9263-b7c0-4b97-b05c-339a1b4f4b5f tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Getting quotas for project 27787b48c024464091785f8308d8733e. Resources: {'key_pairs'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:07:57 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-464e9263-b7c0-4b97-b05c-339a1b4f4b5f tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Getting quotas for user c2141a10d4f543fdaab261486c7e7221 and project 27787b48c024464091785f8308d8733e. Resources: {'key_pairs'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:07:57 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-464e9263-b7c0-4b97-b05c-339a1b4f4b5f tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.189829 Apr 13 15:07:57 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 33/96] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 15:07:57 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:07:58 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1268328026", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "networks": [{"uuid": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e"}], "security_groups": [{"name": "tempest-securitygroup--1911048789"}], "key_name": "tempest-keypair-38678878", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:07:58 user devstack@n-api.service[61872]: DEBUG nova.network.neutron [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] validate_networks() for [('ef80378f-a9cf-4f0f-80cd-90ff2384f88e', None, None, None, None, None)] {{(pid=61872) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:07:59 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Flavor limits 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:07:59 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Image limits 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:07:59 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Flavor pref 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:07:59 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Image pref 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:07:59 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:07:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:07:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:07:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:07:59 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Getting quotas for project 8f7b81912360422a8413f8760b0cf7e1. Resources: {'cores', 'instances', 'ram'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:07:59 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Getting quotas for user 54b07929cf2c404ab10ce944437e9e97 and project 8f7b81912360422a8413f8760b0cf7e1. Resources: {'cores', 'instances', 'ram'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:07:59 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Going to run 1 instances... {{(pid=61872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:07:59 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:07:59 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.761445 Apr 13 15:07:59 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 32/97] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:07:58 2023] POST /compute/v2.1/servers => generated 404 bytes in 1764 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:07:59 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c17397f0-67fc-4c16-a103-66d587c7f011 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:07:59 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-c17397f0-67fc-4c16-a103-66d587c7f011 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:07:59 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=14 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:07:59 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-53f8feb7-a1c5-4830-9fca-d12363b79168 req-87cdb2ff-ba0a-4f61-b995-c12293253483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63f69337-7ae4-4125-a560-f6cbcb2298d4", "tag": "f1e3287f-407f-49f2-8d91-881e31471ee9"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-53f8feb7-a1c5-4830-9fca-d12363b79168 req-87cdb2ff-ba0a-4f61-b995-c12293253483 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-53f8feb7-a1c5-4830-9fca-d12363b79168 req-87cdb2ff-ba0a-4f61-b995-c12293253483 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-53f8feb7-a1c5-4830-9fca-d12363b79168 req-87cdb2ff-ba0a-4f61-b995-c12293253483 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:00 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-53f8feb7-a1c5-4830-9fca-d12363b79168 req-87cdb2ff-ba0a-4f61-b995-c12293253483 service nova] Creating event network-changed:f1e3287f-407f-49f2-8d91-881e31471ee9 for instance 63f69337-7ae4-4125-a560-f6cbcb2298d4 on user Apr 13 15:08:00 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-53f8feb7-a1c5-4830-9fca-d12363b79168 req-87cdb2ff-ba0a-4f61-b995-c12293253483 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066489 Apr 13 15:08:00 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 34/98] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:07:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:00 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-c17397f0-67fc-4c16-a103-66d587c7f011 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b07929cf2c404ab10ce944437e9e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7b81912360422a8413f8760b0cf7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:00 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-c17397f0-67fc-4c16-a103-66d587c7f011 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719" status: 200 len: 1234 microversion: 2.1 time: 0.194052 Apr 13 15:08:00 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 33/99] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:07:59 2023] GET /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719 => generated 1234 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:08:00 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-f2117fd5-0c6b-4a85-9a9e-5b8d44d72a6f req-97588bb2-b11e-4cf0-8206-b75369614d70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "051e6c4e-3d10-4b43-9099-7abffd84d0d9", "tag": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:00 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f2117fd5-0c6b-4a85-9a9e-5b8d44d72a6f req-97588bb2-b11e-4cf0-8206-b75369614d70 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:00 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f2117fd5-0c6b-4a85-9a9e-5b8d44d72a6f req-97588bb2-b11e-4cf0-8206-b75369614d70 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:00 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f2117fd5-0c6b-4a85-9a9e-5b8d44d72a6f req-97588bb2-b11e-4cf0-8206-b75369614d70 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:00 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-f2117fd5-0c6b-4a85-9a9e-5b8d44d72a6f req-97588bb2-b11e-4cf0-8206-b75369614d70 service nova] Creating event network-changed:a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f for instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 on user Apr 13 15:08:00 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-f2117fd5-0c6b-4a85-9a9e-5b8d44d72a6f req-97588bb2-b11e-4cf0-8206-b75369614d70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048542 Apr 13 15:08:00 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 33/100] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:01 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-955792819", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "networks": [{"uuid": "e30a4e6a-48e9-4a29-9721-5a01fc24588e"}], "security_groups": [{"name": "tempest-securitygroup--2086737147"}], "key_name": "tempest-keypair-207135700", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:01 user devstack@n-api.service[61873]: DEBUG nova.network.neutron [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] validate_networks() for [('e30a4e6a-48e9-4a29-9721-5a01fc24588e', None, None, None, None, None)] {{(pid=61873) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:08:02 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-e96f1e1e-2841-4c26-ada9-2f6cc5e94e09 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Action: 'create', calling method: .version_select at 0x7f3a8ff11870>, body: {"keypair": {"name": "tempest-keypair-1905935028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBq9S0cYEjOdCELWE2pKguGrXbpsmvgxJBR+qOuiE9S1dyELdofxdi/TTNTfkVSGHEbBC+G3lepo5cFG2wkiBLOH0DBLXClHmHJvcIb9z3NLVlO9t78kWhP1T9srfjA+A=="}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:02 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-e96f1e1e-2841-4c26-ada9-2f6cc5e94e09 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Getting quotas for project be23bf27d7ed4f0abf2fdc60ae1edb71. Resources: {'key_pairs'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:08:02 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-e96f1e1e-2841-4c26-ada9-2f6cc5e94e09 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Getting quotas for user 5b59f4d6492a4821a621b18766bf58fa and project be23bf27d7ed4f0abf2fdc60ae1edb71. Resources: {'key_pairs'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:08:02 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-e96f1e1e-2841-4c26-ada9-2f6cc5e94e09 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.121490 Apr 13 15:08:02 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 34/101] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 15:08:02 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 15:08:03 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Flavor limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:08:03 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Image limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:08:03 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Flavor pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:08:03 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Image pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:08:03 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:08:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:03 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Getting quotas for project 27787b48c024464091785f8308d8733e. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:08:03 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Getting quotas for user c2141a10d4f543fdaab261486c7e7221 and project 27787b48c024464091785f8308d8733e. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:08:03 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Going to run 1 instances... {{(pid=61873) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:08:03 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:08:03 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.138679 Apr 13 15:08:03 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 35/102] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:08:01 2023] POST /compute/v2.1/servers => generated 404 bytes in 2149 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:08:03 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-fdac0e6c-d6ac-4c1d-ae29-a20553b57fd9 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:08:03 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-fdac0e6c-d6ac-4c1d-ae29-a20553b57fd9 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:08:03 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-fdac0e6c-d6ac-4c1d-ae29-a20553b57fd9 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2141a10d4f543fdaab261486c7e7221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27787b48c024464091785f8308d8733e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:03 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-fdac0e6c-d6ac-4c1d-ae29-a20553b57fd9 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] 10.0.0.210 "GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd" status: 200 len: 1224 microversion: 2.1 time: 0.157667 Apr 13 15:08:03 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 34/103] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:08:03 2023] GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd => generated 1224 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:08:03 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-6adc3e88-d9e9-4394-afe8-ada603faa451 req-ef8d7f1f-8105-4298-a496-f6a894546b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f69337-7ae4-4125-a560-f6cbcb2298d4", "name": "network-vif-plugged", "status": "completed", "tag": "f1e3287f-407f-49f2-8d91-881e31471ee9"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:03 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-6adc3e88-d9e9-4394-afe8-ada603faa451 req-ef8d7f1f-8105-4298-a496-f6a894546b4d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:03 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-6adc3e88-d9e9-4394-afe8-ada603faa451 req-ef8d7f1f-8105-4298-a496-f6a894546b4d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:03 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-6adc3e88-d9e9-4394-afe8-ada603faa451 req-ef8d7f1f-8105-4298-a496-f6a894546b4d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:03 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-6adc3e88-d9e9-4394-afe8-ada603faa451 req-ef8d7f1f-8105-4298-a496-f6a894546b4d service nova] Creating event network-vif-plugged:f1e3287f-407f-49f2-8d91-881e31471ee9 for instance 63f69337-7ae4-4125-a560-f6cbcb2298d4 on user Apr 13 15:08:03 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-6adc3e88-d9e9-4394-afe8-ada603faa451 req-ef8d7f1f-8105-4298-a496-f6a894546b4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057582 Apr 13 15:08:03 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 35/104] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-df576384-d6e2-43c0-b6a3-a4c793502db3 req-2727dbde-a628-4777-af41-3b485e039bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be0a3f9-0dae-4739-9f1e-0bb416a97719", "tag": "daee05dc-ae07-4d68-94f3-7c2ee8039327"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-df576384-d6e2-43c0-b6a3-a4c793502db3 req-2727dbde-a628-4777-af41-3b485e039bb6 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-df576384-d6e2-43c0-b6a3-a4c793502db3 req-2727dbde-a628-4777-af41-3b485e039bb6 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-df576384-d6e2-43c0-b6a3-a4c793502db3 req-2727dbde-a628-4777-af41-3b485e039bb6 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:05 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-df576384-d6e2-43c0-b6a3-a4c793502db3 req-2727dbde-a628-4777-af41-3b485e039bb6 service nova] Creating event network-changed:daee05dc-ae07-4d68-94f3-7c2ee8039327 for instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 on user Apr 13 15:08:05 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-df576384-d6e2-43c0-b6a3-a4c793502db3 req-2727dbde-a628-4777-af41-3b485e039bb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037908 Apr 13 15:08:05 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 36/105] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-f85d6641-6bda-42e2-ae99-c633301589ed req-c7002d73-4619-4bd1-89fa-3894596f99d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f69337-7ae4-4125-a560-f6cbcb2298d4", "name": "network-vif-plugged", "status": "completed", "tag": "f1e3287f-407f-49f2-8d91-881e31471ee9"}, {"server_uuid": "051e6c4e-3d10-4b43-9099-7abffd84d0d9", "name": "network-vif-plugged", "status": "completed", "tag": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f85d6641-6bda-42e2-ae99-c633301589ed req-c7002d73-4619-4bd1-89fa-3894596f99d5 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f85d6641-6bda-42e2-ae99-c633301589ed req-c7002d73-4619-4bd1-89fa-3894596f99d5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f85d6641-6bda-42e2-ae99-c633301589ed req-c7002d73-4619-4bd1-89fa-3894596f99d5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:05 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=17 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:05 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-f85d6641-6bda-42e2-ae99-c633301589ed req-c7002d73-4619-4bd1-89fa-3894596f99d5 service nova] Creating event network-vif-plugged:f1e3287f-407f-49f2-8d91-881e31471ee9 for instance 63f69337-7ae4-4125-a560-f6cbcb2298d4 on user Apr 13 15:08:05 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-f85d6641-6bda-42e2-ae99-c633301589ed req-c7002d73-4619-4bd1-89fa-3894596f99d5 service nova] Creating event network-vif-plugged:a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f for instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 on user Apr 13 15:08:05 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-f85d6641-6bda-42e2-ae99-c633301589ed req-c7002d73-4619-4bd1-89fa-3894596f99d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060619 Apr 13 15:08:05 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 35/106] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2055562483", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "4f48b4f3-f64b-428b-b729-0d4305647e89"}], "security_groups": [{"name": "tempest-securitygroup--1775073662"}], "key_name": "tempest-keypair-1905935028", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:06 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] validate_networks() for [('4f48b4f3-f64b-428b-b729-0d4305647e89', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:08:06 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:08:06 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:08:06 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:08:06 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:08:06 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:08:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:06 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Getting quotas for project be23bf27d7ed4f0abf2fdc60ae1edb71. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:08:06 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Getting quotas for user 5b59f4d6492a4821a621b18766bf58fa and project be23bf27d7ed4f0abf2fdc60ae1edb71. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:08:06 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:08:06 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:08:06 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 0.842924 Apr 13 15:08:06 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 36/107] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 15:08:06 2023] POST /compute/v2.1/servers => generated 404 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 15:08:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f1ff9e60-c87a-4d8a-b45d-05a190939c3e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:08:06 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-f1ff9e60-c87a-4d8a-b45d-05a190939c3e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:08:07 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-f1ff9e60-c87a-4d8a-b45d-05a190939c3e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b59f4d6492a4821a621b18766bf58fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23bf27d7ed4f0abf2fdc60ae1edb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:07 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-f1ff9e60-c87a-4d8a-b45d-05a190939c3e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b59f4d6492a4821a621b18766bf58fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23bf27d7ed4f0abf2fdc60ae1edb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:07 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-f1ff9e60-c87a-4d8a-b45d-05a190939c3e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b59f4d6492a4821a621b18766bf58fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23bf27d7ed4f0abf2fdc60ae1edb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:07 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-f1ff9e60-c87a-4d8a-b45d-05a190939c3e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" status: 200 len: 1321 microversion: 2.49 time: 0.115372 Apr 13 15:08:07 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 37/108] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:08:06 2023] GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc => generated 1321 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:08:07 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-9f19e763-72ad-4f0d-8f83-ea8e2de8d880 req-00b0bfd1-48bc-47e6-9da3-d687ed0237d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "193136fc-e6c3-4e70-b7ab-01ced440c6bd", "tag": "49eab8a0-3140-4872-b606-e03f2a243e2f"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:07 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-bade3759-dd18-46cf-9885-1fe5638c4981 req-2757086e-d1ec-4c28-960d-f597152d3fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "051e6c4e-3d10-4b43-9099-7abffd84d0d9", "name": "network-vif-plugged", "status": "completed", "tag": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-9f19e763-72ad-4f0d-8f83-ea8e2de8d880 req-00b0bfd1-48bc-47e6-9da3-d687ed0237d3 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-9f19e763-72ad-4f0d-8f83-ea8e2de8d880 req-00b0bfd1-48bc-47e6-9da3-d687ed0237d3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-bade3759-dd18-46cf-9885-1fe5638c4981 req-2757086e-d1ec-4c28-960d-f597152d3fa8 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-bade3759-dd18-46cf-9885-1fe5638c4981 req-2757086e-d1ec-4c28-960d-f597152d3fa8 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-bade3759-dd18-46cf-9885-1fe5638c4981 req-2757086e-d1ec-4c28-960d-f597152d3fa8 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-9f19e763-72ad-4f0d-8f83-ea8e2de8d880 req-00b0bfd1-48bc-47e6-9da3-d687ed0237d3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:07 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-bade3759-dd18-46cf-9885-1fe5638c4981 req-2757086e-d1ec-4c28-960d-f597152d3fa8 service nova] Creating event network-vif-plugged:a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f for instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 on user Apr 13 15:08:07 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-bade3759-dd18-46cf-9885-1fe5638c4981 req-2757086e-d1ec-4c28-960d-f597152d3fa8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053070 Apr 13 15:08:07 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 37/109] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:07 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-9f19e763-72ad-4f0d-8f83-ea8e2de8d880 req-00b0bfd1-48bc-47e6-9da3-d687ed0237d3 service nova] Creating event network-changed:49eab8a0-3140-4872-b606-e03f2a243e2f for instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd on user Apr 13 15:08:07 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-9f19e763-72ad-4f0d-8f83-ea8e2de8d880 req-00b0bfd1-48bc-47e6-9da3-d687ed0237d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103973 Apr 13 15:08:07 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 36/110] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:09 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-1d788c32-5e99-4f2b-9d72-3cc3a609ccf0 req-ce3af702-4a4b-4734-91e4-b11fdf685fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be0a3f9-0dae-4739-9f1e-0bb416a97719", "name": "network-vif-plugged", "status": "completed", "tag": "daee05dc-ae07-4d68-94f3-7c2ee8039327"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-1d788c32-5e99-4f2b-9d72-3cc3a609ccf0 req-ce3af702-4a4b-4734-91e4-b11fdf685fdd service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-1d788c32-5e99-4f2b-9d72-3cc3a609ccf0 req-ce3af702-4a4b-4734-91e4-b11fdf685fdd service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-1d788c32-5e99-4f2b-9d72-3cc3a609ccf0 req-ce3af702-4a4b-4734-91e4-b11fdf685fdd service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:09 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-1d788c32-5e99-4f2b-9d72-3cc3a609ccf0 req-ce3af702-4a4b-4734-91e4-b11fdf685fdd service nova] Creating event network-vif-plugged:daee05dc-ae07-4d68-94f3-7c2ee8039327 for instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 on user Apr 13 15:08:09 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-1d788c32-5e99-4f2b-9d72-3cc3a609ccf0 req-ce3af702-4a4b-4734-91e4-b11fdf685fdd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075528 Apr 13 15:08:09 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 38/111] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:10 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-ad4084f8-8e11-414e-a7ca-b8cd81ba7794 req-9d228524-04e0-4d34-a4d4-e54de802870b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "193136fc-e6c3-4e70-b7ab-01ced440c6bd", "name": "network-vif-plugged", "status": "completed", "tag": "49eab8a0-3140-4872-b606-e03f2a243e2f"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ad4084f8-8e11-414e-a7ca-b8cd81ba7794 req-9d228524-04e0-4d34-a4d4-e54de802870b service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ad4084f8-8e11-414e-a7ca-b8cd81ba7794 req-9d228524-04e0-4d34-a4d4-e54de802870b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ad4084f8-8e11-414e-a7ca-b8cd81ba7794 req-9d228524-04e0-4d34-a4d4-e54de802870b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:10 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-ad4084f8-8e11-414e-a7ca-b8cd81ba7794 req-9d228524-04e0-4d34-a4d4-e54de802870b service nova] Creating event network-vif-plugged:49eab8a0-3140-4872-b606-e03f2a243e2f for instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd on user Apr 13 15:08:10 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-ad4084f8-8e11-414e-a7ca-b8cd81ba7794 req-9d228524-04e0-4d34-a4d4-e54de802870b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037010 Apr 13 15:08:10 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 38/112] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:11 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-5bf44802-7c4a-4a25-a9ad-e35c942c2929 req-e3cab4cd-cfb3-47bc-b57b-5afb7e1e4ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be0a3f9-0dae-4739-9f1e-0bb416a97719", "name": "network-vif-plugged", "status": "completed", "tag": "daee05dc-ae07-4d68-94f3-7c2ee8039327"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:11 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=4 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-5bf44802-7c4a-4a25-a9ad-e35c942c2929 req-e3cab4cd-cfb3-47bc-b57b-5afb7e1e4ac7 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-5bf44802-7c4a-4a25-a9ad-e35c942c2929 req-e3cab4cd-cfb3-47bc-b57b-5afb7e1e4ac7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-5bf44802-7c4a-4a25-a9ad-e35c942c2929 req-e3cab4cd-cfb3-47bc-b57b-5afb7e1e4ac7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:11 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-5bf44802-7c4a-4a25-a9ad-e35c942c2929 req-e3cab4cd-cfb3-47bc-b57b-5afb7e1e4ac7 service nova] Creating event network-vif-plugged:daee05dc-ae07-4d68-94f3-7c2ee8039327 for instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 on user Apr 13 15:08:11 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-5bf44802-7c4a-4a25-a9ad-e35c942c2929 req-e3cab4cd-cfb3-47bc-b57b-5afb7e1e4ac7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056455 Apr 13 15:08:11 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 37/113] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:12 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "193136fc-e6c3-4e70-b7ab-01ced440c6bd", "name": "network-vif-plugged", "status": "completed", "tag": "49eab8a0-3140-4872-b606-e03f2a243e2f"}, {"name": "network-changed", "server_uuid": "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc", "tag": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:12 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] Creating event network-vif-plugged:49eab8a0-3140-4872-b606-e03f2a243e2f for instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd on user Apr 13 15:08:12 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] Creating event network-changed:ce8e302f-1f0b-46e0-82ef-9809a6ad81db for instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc on user Apr 13 15:08:12 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.049692 Apr 13 15:08:12 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 39/114] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:12 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:14 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-cc30b10b-926b-4f3a-8f34-74b0ee4963ce tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:08:14 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-cc30b10b-926b-4f3a-8f34-74b0ee4963ce tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:08:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cc30b10b-926b-4f3a-8f34-74b0ee4963ce tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cc30b10b-926b-4f3a-8f34-74b0ee4963ce tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cc30b10b-926b-4f3a-8f34-74b0ee4963ce tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cc30b10b-926b-4f3a-8f34-74b0ee4963ce tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cc30b10b-926b-4f3a-8f34-74b0ee4963ce tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cc30b10b-926b-4f3a-8f34-74b0ee4963ce tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:14 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-a4cafc30-bd90-4378-9706-6361eb9d6eee req-66857ea8-07de-4f60-ad06-81fa1f6480a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc", "name": "network-vif-plugged", "status": "completed", "tag": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db"}, {"server_uuid": "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc", "name": "network-vif-plugged", "status": "completed", "tag": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:14 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=16 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a4cafc30-bd90-4378-9706-6361eb9d6eee req-66857ea8-07de-4f60-ad06-81fa1f6480a7 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a4cafc30-bd90-4378-9706-6361eb9d6eee req-66857ea8-07de-4f60-ad06-81fa1f6480a7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a4cafc30-bd90-4378-9706-6361eb9d6eee req-66857ea8-07de-4f60-ad06-81fa1f6480a7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:15 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-a4cafc30-bd90-4378-9706-6361eb9d6eee req-66857ea8-07de-4f60-ad06-81fa1f6480a7 service nova] Creating event network-vif-plugged:ce8e302f-1f0b-46e0-82ef-9809a6ad81db for instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc on user Apr 13 15:08:15 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-a4cafc30-bd90-4378-9706-6361eb9d6eee req-66857ea8-07de-4f60-ad06-81fa1f6480a7 service nova] Creating event network-vif-plugged:ce8e302f-1f0b-46e0-82ef-9809a6ad81db for instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc on user Apr 13 15:08:15 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-a4cafc30-bd90-4378-9706-6361eb9d6eee req-66857ea8-07de-4f60-ad06-81fa1f6480a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043868 Apr 13 15:08:15 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 38/115] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:15 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-cc30b10b-926b-4f3a-8f34-74b0ee4963ce tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844897ef27d4395af0a8f069699ce4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62589c1782f2473ead9b4270af3982f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:15 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-cc30b10b-926b-4f3a-8f34-74b0ee4963ce tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5" status: 200 len: 1487 microversion: 2.1 time: 0.449648 Apr 13 15:08:15 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 39/116] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:08:14 2023] GET /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5 => generated 1487 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:08:18 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-b180f290-97b6-4c5a-9882-f1f18eb17354 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Action: 'create', calling method: .version_select at 0x7f3a8bf32050>, body: {"keypair": {"name": "tempest-keypair-522600936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w=="}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:18 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:18 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=18 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:18 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-b180f290-97b6-4c5a-9882-f1f18eb17354 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Getting quotas for project d530eb6a4bf04f468299323520f56d1d. Resources: {'key_pairs'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:08:18 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-b180f290-97b6-4c5a-9882-f1f18eb17354 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Getting quotas for user 40c18c8a515b457088a9901fbc86629f and project d530eb6a4bf04f468299323520f56d1d. Resources: {'key_pairs'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:08:18 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-b180f290-97b6-4c5a-9882-f1f18eb17354 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.091381 Apr 13 15:08:18 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 40/117] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 15:08:18 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 94 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 15:08:18 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-758b8ec9-9d23-40c7-a1fa-7b7365ffa62b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:08:18 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-758b8ec9-9d23-40c7-a1fa-7b7365ffa62b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:08:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-758b8ec9-9d23-40c7-a1fa-7b7365ffa62b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-758b8ec9-9d23-40c7-a1fa-7b7365ffa62b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-758b8ec9-9d23-40c7-a1fa-7b7365ffa62b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-758b8ec9-9d23-40c7-a1fa-7b7365ffa62b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-758b8ec9-9d23-40c7-a1fa-7b7365ffa62b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-758b8ec9-9d23-40c7-a1fa-7b7365ffa62b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:19 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-758b8ec9-9d23-40c7-a1fa-7b7365ffa62b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:19 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-758b8ec9-9d23-40c7-a1fa-7b7365ffa62b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25f57234-8818-44d3-b476-d6cfba7b2810" status: 200 len: 1503 microversion: 2.1 time: 0.372128 Apr 13 15:08:19 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 39/118] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:08:18 2023] GET /compute/v2.1/servers/25f57234-8818-44d3-b476-d6cfba7b2810 => generated 1503 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:08:20 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:20 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=18 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:20 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1904364306", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "7a95cb70-f248-48c3-bcaf-29e420112188"}, {"port": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "tag": "port-1"}, {"port": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "tag": "port-2"}, {"uuid": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "tag": "net-1"}, {"uuid": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78"}, {"uuid": "d3469945-df22-46a3-b22f-8f2b269fe93a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "d3469945-df22-46a3-b22f-8f2b269fe93a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a098f171-2580-4930-a4a3-79cac86e30d6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "3296f7da-aff3-46a3-8567-6d8fd71c9ece", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "a62eeb8c-6d75-4da8-8262-5afab3861b5a", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1693085043"}], "key_name": "tempest-keypair-522600936", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:20 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] validate_networks() for [('7a95cb70-f248-48c3-bcaf-29e420112188', None, None, None, None, None), (None, None, 'f81f8894-95c8-443a-92e6-0bbc31c8e87c', None, None, None), (None, None, 'd2e29dc8-81b4-4712-9be4-e97c7f116aed', None, None, None), ('8714ab90-e3fa-42fe-9a01-0fafb55cbb78', None, None, None, None, None), ('8714ab90-e3fa-42fe-9a01-0fafb55cbb78', None, None, None, None, None), ('d3469945-df22-46a3-b22f-8f2b269fe93a', '10.2.2.100', None, None, None, None), ('d3469945-df22-46a3-b22f-8f2b269fe93a', '10.2.2.200', None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:08:23 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:08:23 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:08:23 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:08:23 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:08:23 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:08:23 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=5 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:23 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Getting quotas for project d530eb6a4bf04f468299323520f56d1d. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:08:23 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Getting quotas for user 40c18c8a515b457088a9901fbc86629f and project d530eb6a4bf04f468299323520f56d1d. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:08:23 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:08:23 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a098f171-2580-4930-a4a3-79cac86e30d6',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='3296f7da-aff3-46a3-8567-6d8fd71c9ece',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a62eeb8c-6d75-4da8-8262-5afab3861b5a',volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:08:24 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 3.779566 Apr 13 15:08:24 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 40/119] 10.0.0.210 () {66 vars in 1266 bytes} [Thu Apr 13 15:08:20 2023] POST /compute/v2.1/servers => generated 404 bytes in 3781 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 15:08:24 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=15 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:24 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-a1a2f58b-09d1-4455-aaea-166524d3a7a2 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:08:24 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-a1a2f58b-09d1-4455-aaea-166524d3a7a2 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:08:24 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=8 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:24 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-a1a2f58b-09d1-4455-aaea-166524d3a7a2 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c18c8a515b457088a9901fbc86629f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd530eb6a4bf04f468299323520f56d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:24 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-a1a2f58b-09d1-4455-aaea-166524d3a7a2 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40c18c8a515b457088a9901fbc86629f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd530eb6a4bf04f468299323520f56d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:24 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-a1a2f58b-09d1-4455-aaea-166524d3a7a2 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40c18c8a515b457088a9901fbc86629f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd530eb6a4bf04f468299323520f56d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:24 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-a1a2f58b-09d1-4455-aaea-166524d3a7a2 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944" status: 200 len: 1279 microversion: 2.32 time: 0.100881 Apr 13 15:08:24 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 41/120] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:08:24 2023] GET /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944 => generated 1279 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:08:24 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-61df2411-543a-4ff6-bf98-35a5fdbd6c61 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:08:24 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-61df2411-543a-4ff6-bf98-35a5fdbd6c61 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:08:24 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-61df2411-543a-4ff6-bf98-35a5fdbd6c61 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-61df2411-543a-4ff6-bf98-35a5fdbd6c61 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-61df2411-543a-4ff6-bf98-35a5fdbd6c61 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-61df2411-543a-4ff6-bf98-35a5fdbd6c61 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-61df2411-543a-4ff6-bf98-35a5fdbd6c61 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-61df2411-543a-4ff6-bf98-35a5fdbd6c61 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:24 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-61df2411-543a-4ff6-bf98-35a5fdbd6c61 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:24 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-61df2411-543a-4ff6-bf98-35a5fdbd6c61 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:24 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-61df2411-543a-4ff6-bf98-35a5fdbd6c61 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:24 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-61df2411-543a-4ff6-bf98-35a5fdbd6c61 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" status: 200 len: 1690 microversion: 2.87 time: 0.216913 Apr 13 15:08:24 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 40/121] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:08:24 2023] GET /compute/v2.1/servers/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba => generated 1690 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:08:28 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-df77c171-fd30-48a3-804e-25d8f6f60b39 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:08:28 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-df77c171-fd30-48a3-804e-25d8f6f60b39 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:08:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-df77c171-fd30-48a3-804e-25d8f6f60b39 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-df77c171-fd30-48a3-804e-25d8f6f60b39 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-df77c171-fd30-48a3-804e-25d8f6f60b39 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-df77c171-fd30-48a3-804e-25d8f6f60b39 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-df77c171-fd30-48a3-804e-25d8f6f60b39 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-df77c171-fd30-48a3-804e-25d8f6f60b39 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:29 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-df77c171-fd30-48a3-804e-25d8f6f60b39 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30a69b780664742aed58bd9a578e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5acb52755c74d118d012e38feed7237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:29 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-df77c171-fd30-48a3-804e-25d8f6f60b39 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818" status: 200 len: 1553 microversion: 2.1 time: 0.226920 Apr 13 15:08:29 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 41/122] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:08:28 2023] GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818 => generated 1553 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:08:31 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-3facb4de-bad8-4ab2-9cbb-e48351ed49a1 req-712f4f88-5518-42ed-9152-7a75dbe01bff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "tag": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3facb4de-bad8-4ab2-9cbb-e48351ed49a1 req-712f4f88-5518-42ed-9152-7a75dbe01bff service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3facb4de-bad8-4ab2-9cbb-e48351ed49a1 req-712f4f88-5518-42ed-9152-7a75dbe01bff service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3facb4de-bad8-4ab2-9cbb-e48351ed49a1 req-712f4f88-5518-42ed-9152-7a75dbe01bff service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:31 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-3facb4de-bad8-4ab2-9cbb-e48351ed49a1 req-712f4f88-5518-42ed-9152-7a75dbe01bff service nova] Creating event network-changed:6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:31 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-3facb4de-bad8-4ab2-9cbb-e48351ed49a1 req-712f4f88-5518-42ed-9152-7a75dbe01bff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066950 Apr 13 15:08:31 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 42/123] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:08:33 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-25e3413b-8f9d-430e-a489-6e10ec7e8a22 req-15177f60-f6f2-49a5-aab9-6c3af64281ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "tag": "f81f8894-95c8-443a-92e6-0bbc31c8e87c"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:34 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-25e3413b-8f9d-430e-a489-6e10ec7e8a22 req-15177f60-f6f2-49a5-aab9-6c3af64281ed service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:34 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-25e3413b-8f9d-430e-a489-6e10ec7e8a22 req-15177f60-f6f2-49a5-aab9-6c3af64281ed service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:34 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-25e3413b-8f9d-430e-a489-6e10ec7e8a22 req-15177f60-f6f2-49a5-aab9-6c3af64281ed service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:34 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-25e3413b-8f9d-430e-a489-6e10ec7e8a22 req-15177f60-f6f2-49a5-aab9-6c3af64281ed service nova] Creating event network-changed:f81f8894-95c8-443a-92e6-0bbc31c8e87c for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:34 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-25e3413b-8f9d-430e-a489-6e10ec7e8a22 req-15177f60-f6f2-49a5-aab9-6c3af64281ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030017 Apr 13 15:08:34 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 41/124] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:36 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "tag": "d2e29dc8-81b4-4712-9be4-e97c7f116aed"}, {"name": "network-changed", "server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "tag": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd"}, {"name": "network-changed", "server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "tag": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:36 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:36 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:36 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:36 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:36 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:36 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=23 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:36 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] Creating event network-changed:d2e29dc8-81b4-4712-9be4-e97c7f116aed for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:36 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] Creating event network-changed:0bbdcb7f-44fc-4144-9dcc-b82be1a036fd for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:36 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] Creating event network-changed:a1f1b21e-12c3-4310-9ef0-791f4d09fc5f for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:36 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.034246 Apr 13 15:08:36 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 42/125] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:36 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:38 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "tag": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69"}, {"name": "network-changed", "server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "tag": "c97ac499-c8fa-412e-9452-c6f80e69c879"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:38 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:38 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] Creating event network-changed:989ec3b8-1a00-47b5-9a07-71f33cfb6c69 for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:38 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] Creating event network-changed:c97ac499-c8fa-412e-9452-c6f80e69c879 for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:38 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035843 Apr 13 15:08:38 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 43/126] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:38 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:43 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-90568925-7d62-4711-9132-3667ab21dc53 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:08:43 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-90568925-7d62-4711-9132-3667ab21dc53 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:08:43 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-90568925-7d62-4711-9132-3667ab21dc53 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:43 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-90568925-7d62-4711-9132-3667ab21dc53 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:43 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-90568925-7d62-4711-9132-3667ab21dc53 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:43 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-90568925-7d62-4711-9132-3667ab21dc53 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:43 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-90568925-7d62-4711-9132-3667ab21dc53 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:43 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-90568925-7d62-4711-9132-3667ab21dc53 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:43 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=22 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:43 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-7ae18f3b-b1f8-48f7-8738-89835446f3fe tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:08:43 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-7ae18f3b-b1f8-48f7-8738-89835446f3fe tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:08:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7ae18f3b-b1f8-48f7-8738-89835446f3fe tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7ae18f3b-b1f8-48f7-8738-89835446f3fe tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7ae18f3b-b1f8-48f7-8738-89835446f3fe tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7ae18f3b-b1f8-48f7-8738-89835446f3fe tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7ae18f3b-b1f8-48f7-8738-89835446f3fe tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7ae18f3b-b1f8-48f7-8738-89835446f3fe tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:44 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-90568925-7d62-4711-9132-3667ab21dc53 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8adc8b289e548a5ac16b6356753d6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c1b992977a479883e445330b3d0d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:44 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-90568925-7d62-4711-9132-3667ab21dc53 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] 10.0.0.210 "GET /compute/v2.1/servers/63f69337-7ae4-4125-a560-f6cbcb2298d4" status: 200 len: 1454 microversion: 2.1 time: 0.184019 Apr 13 15:08:44 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 42/127] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:08:43 2023] GET /compute/v2.1/servers/63f69337-7ae4-4125-a560-f6cbcb2298d4 => generated 1454 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:08:44 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-7ae18f3b-b1f8-48f7-8738-89835446f3fe tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6747b03238c481d836caaf583f20a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fbef55fb3c43d69af48208d28c87f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:44 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-7ae18f3b-b1f8-48f7-8738-89835446f3fe tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9" status: 200 len: 1548 microversion: 2.1 time: 0.251817 Apr 13 15:08:44 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 43/128] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:08:43 2023] GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9 => generated 1548 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:08:46 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-9f60fb3e-da5e-4c87-b9b2-4288a10d445f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Action: 'create', calling method: .version_select at 0x7f3a8bf332e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-771163491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMiNMWIbugIqPibluDtkgkNEHAz0dy1D5iz8h+LzuOQnT0xmd5kr4yKVwXHq5lSKq5W4WLRwRbSWAGEOzySrgPdrDDGPAIFjjmc2lQ7zaPxRPWJoiG7d4rgdJ1tvZwk/g=="}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:46 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-9f60fb3e-da5e-4c87-b9b2-4288a10d445f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Getting quotas for project 7227559570b54e92be19d25938523b49. Resources: {'key_pairs'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:08:46 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-9f60fb3e-da5e-4c87-b9b2-4288a10d445f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Getting quotas for user 2fc0cce3df7540078438186f46ca4621 and project 7227559570b54e92be19d25938523b49. Resources: {'key_pairs'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:08:46 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-9f60fb3e-da5e-4c87-b9b2-4288a10d445f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.245507 Apr 13 15:08:46 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 44/129] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 15:08:46 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:50 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-0f4d0a14-f9b9-49ff-bb76-385b27b203f6 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:08:50 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-0f4d0a14-f9b9-49ff-bb76-385b27b203f6 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:08:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0f4d0a14-f9b9-49ff-bb76-385b27b203f6 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0f4d0a14-f9b9-49ff-bb76-385b27b203f6 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0f4d0a14-f9b9-49ff-bb76-385b27b203f6 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0f4d0a14-f9b9-49ff-bb76-385b27b203f6 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0f4d0a14-f9b9-49ff-bb76-385b27b203f6 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0f4d0a14-f9b9-49ff-bb76-385b27b203f6 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:50 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-afbe078b-307a-468e-b1b8-335eceecc7a3 req-21bd1f97-45be-4d5f-920b-500936191d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-afbe078b-307a-468e-b1b8-335eceecc7a3 req-21bd1f97-45be-4d5f-920b-500936191d5d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-afbe078b-307a-468e-b1b8-335eceecc7a3 req-21bd1f97-45be-4d5f-920b-500936191d5d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-afbe078b-307a-468e-b1b8-335eceecc7a3 req-21bd1f97-45be-4d5f-920b-500936191d5d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:50 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-afbe078b-307a-468e-b1b8-335eceecc7a3 req-21bd1f97-45be-4d5f-920b-500936191d5d service nova] Creating event network-vif-plugged:6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:50 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-afbe078b-307a-468e-b1b8-335eceecc7a3 req-21bd1f97-45be-4d5f-920b-500936191d5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044943 Apr 13 15:08:50 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 44/130] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:50 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-0f4d0a14-f9b9-49ff-bb76-385b27b203f6 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b07929cf2c404ab10ce944437e9e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7b81912360422a8413f8760b0cf7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:50 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-0f4d0a14-f9b9-49ff-bb76-385b27b203f6 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719" status: 200 len: 1544 microversion: 2.1 time: 0.536865 Apr 13 15:08:50 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 43/131] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:08:50 2023] GET /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719 => generated 1544 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:08:51 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:51 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-adf268a9-9f60-4297-9717-18806a605fb0 req-377e0a96-b406-4559-99d6-e8b1313fece7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-adf268a9-9f60-4297-9717-18806a605fb0 req-377e0a96-b406-4559-99d6-e8b1313fece7 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-adf268a9-9f60-4297-9717-18806a605fb0 req-377e0a96-b406-4559-99d6-e8b1313fece7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-adf268a9-9f60-4297-9717-18806a605fb0 req-377e0a96-b406-4559-99d6-e8b1313fece7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:51 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-adf268a9-9f60-4297-9717-18806a605fb0 req-377e0a96-b406-4559-99d6-e8b1313fece7 service nova] Creating event network-vif-plugged:0bbdcb7f-44fc-4144-9dcc-b82be1a036fd for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:51 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-adf268a9-9f60-4297-9717-18806a605fb0 req-377e0a96-b406-4559-99d6-e8b1313fece7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063298 Apr 13 15:08:51 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 45/132] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:52 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-411290166", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-771163491", "security_groups": [{"name": "tempest-secgroup-smoke-1089020874"}], "networks": [{"uuid": "a191c30d-997a-46b8-bcc2-78a766c1bae2"}], "block_device_mapping_v2": [{"uuid": "0ddca559-4699-4c09-aca9-db61ea2e7961", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:52 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] validate_networks() for [('a191c30d-997a-46b8-bcc2-78a766c1bae2', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:08:52 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "f81f8894-95c8-443a-92e6-0bbc31c8e87c"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "f81f8894-95c8-443a-92e6-0bbc31c8e87c"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "d2e29dc8-81b4-4712-9be4-e97c7f116aed"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "d2e29dc8-81b4-4712-9be4-e97c7f116aed"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:52 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Creating event network-vif-plugged:6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:52 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Creating event network-vif-plugged:f81f8894-95c8-443a-92e6-0bbc31c8e87c for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:52 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Creating event network-vif-plugged:f81f8894-95c8-443a-92e6-0bbc31c8e87c for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:52 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Creating event network-vif-plugged:d2e29dc8-81b4-4712-9be4-e97c7f116aed for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:52 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Creating event network-vif-plugged:d2e29dc8-81b4-4712-9be4-e97c7f116aed for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:52 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Creating event network-vif-plugged:989ec3b8-1a00-47b5-9a07-71f33cfb6c69 for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:52 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.032176 Apr 13 15:08:52 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 44/133] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:52 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:08:52 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:08:52 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:08:52 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:08:52 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:08:52 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:08:52 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:53 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Getting quotas for project 7227559570b54e92be19d25938523b49. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:08:53 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Getting quotas for user 2fc0cce3df7540078438186f46ca4621 and project 7227559570b54e92be19d25938523b49. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:08:53 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:08:53 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ddca559-4699-4c09-aca9-db61ea2e7961',volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:08:53 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.132925 Apr 13 15:08:53 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 45/134] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:08:52 2023] POST /compute/v2.1/servers => generated 404 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:08:53 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-926db215-7b36-4cb0-8cd8-a8b05fc77d3e tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:08:53 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-926db215-7b36-4cb0-8cd8-a8b05fc77d3e tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:08:53 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-926db215-7b36-4cb0-8cd8-a8b05fc77d3e tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc0cce3df7540078438186f46ca4621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7227559570b54e92be19d25938523b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:53 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-926db215-7b36-4cb0-8cd8-a8b05fc77d3e tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211" status: 200 len: 1082 microversion: 2.1 time: 0.077398 Apr 13 15:08:53 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 46/135] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:08:53 2023] GET /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211 => generated 1082 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:08:53 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d081b32d-7552-4a5e-a67f-892f192651d1 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:08:53 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-d081b32d-7552-4a5e-a67f-892f192651d1 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:08:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d081b32d-7552-4a5e-a67f-892f192651d1 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d081b32d-7552-4a5e-a67f-892f192651d1 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d081b32d-7552-4a5e-a67f-892f192651d1 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d081b32d-7552-4a5e-a67f-892f192651d1 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d081b32d-7552-4a5e-a67f-892f192651d1 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d081b32d-7552-4a5e-a67f-892f192651d1 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:53 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:53 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:53 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-d081b32d-7552-4a5e-a67f-892f192651d1 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2141a10d4f543fdaab261486c7e7221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27787b48c024464091785f8308d8733e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:53 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-d081b32d-7552-4a5e-a67f-892f192651d1 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] 10.0.0.210 "GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd" status: 200 len: 1524 microversion: 2.1 time: 0.167269 Apr 13 15:08:53 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 45/136] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:08:53 2023] GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd => generated 1524 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 15:08:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:53 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] Creating event network-vif-plugged:0bbdcb7f-44fc-4144-9dcc-b82be1a036fd for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:53 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] Creating event network-vif-plugged:a1f1b21e-12c3-4310-9ef0-791f4d09fc5f for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:53 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] Creating event network-vif-plugged:a1f1b21e-12c3-4310-9ef0-791f4d09fc5f for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:53 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.070539 Apr 13 15:08:53 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 46/137] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:53 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:54 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "c97ac499-c8fa-412e-9452-c6f80e69c879"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "c97ac499-c8fa-412e-9452-c6f80e69c879"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:54 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:54 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:54 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:54 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:54 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] Creating event network-vif-plugged:989ec3b8-1a00-47b5-9a07-71f33cfb6c69 for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:54 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] Creating event network-vif-plugged:c97ac499-c8fa-412e-9452-c6f80e69c879 for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:54 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] Creating event network-vif-plugged:c97ac499-c8fa-412e-9452-c6f80e69c879 for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:08:54 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.036757 Apr 13 15:08:54 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 47/138] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:54 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:56 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-9d1ca3d2-d075-44b1-be06-9cae4c0fc0ea req-29a79691-b031-4d01-882d-5fec62a5d702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179b6945-589d-402c-a89e-6b8d68725211", "tag": "b6a42460-29f0-496d-a7ba-d7ae2259f317"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:08:56 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=14 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:08:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-9d1ca3d2-d075-44b1-be06-9cae4c0fc0ea req-29a79691-b031-4d01-882d-5fec62a5d702 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-9d1ca3d2-d075-44b1-be06-9cae4c0fc0ea req-29a79691-b031-4d01-882d-5fec62a5d702 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-9d1ca3d2-d075-44b1-be06-9cae4c0fc0ea req-29a79691-b031-4d01-882d-5fec62a5d702 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:56 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-9d1ca3d2-d075-44b1-be06-9cae4c0fc0ea req-29a79691-b031-4d01-882d-5fec62a5d702 service nova] Creating event network-changed:b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance 179b6945-589d-402c-a89e-6b8d68725211 on user Apr 13 15:08:56 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-9d1ca3d2-d075-44b1-be06-9cae4c0fc0ea req-29a79691-b031-4d01-882d-5fec62a5d702 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040340 Apr 13 15:08:56 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 46/139] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:08:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:08:57 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-a6a1a097-a0dd-4cc8-afdd-7896d63b64bb tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:08:57 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-a6a1a097-a0dd-4cc8-afdd-7896d63b64bb tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:08:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a6a1a097-a0dd-4cc8-afdd-7896d63b64bb tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a6a1a097-a0dd-4cc8-afdd-7896d63b64bb tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a6a1a097-a0dd-4cc8-afdd-7896d63b64bb tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a6a1a097-a0dd-4cc8-afdd-7896d63b64bb tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:08:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a6a1a097-a0dd-4cc8-afdd-7896d63b64bb tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:08:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a6a1a097-a0dd-4cc8-afdd-7896d63b64bb tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:08:57 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-a6a1a097-a0dd-4cc8-afdd-7896d63b64bb tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b59f4d6492a4821a621b18766bf58fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23bf27d7ed4f0abf2fdc60ae1edb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:57 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-a6a1a097-a0dd-4cc8-afdd-7896d63b64bb tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b59f4d6492a4821a621b18766bf58fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23bf27d7ed4f0abf2fdc60ae1edb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:57 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-a6a1a097-a0dd-4cc8-afdd-7896d63b64bb tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b59f4d6492a4821a621b18766bf58fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23bf27d7ed4f0abf2fdc60ae1edb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:08:57 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-a6a1a097-a0dd-4cc8-afdd-7896d63b64bb tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" status: 200 len: 1629 microversion: 2.49 time: 0.208562 Apr 13 15:08:57 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 47/140] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:08:57 2023] GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc => generated 1629 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:09:02 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-a7b023d1-deaf-4b97-84b9-7224f5decd67 req-5334616e-f953-4b34-971d-401c6930224b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179b6945-589d-402c-a89e-6b8d68725211", "name": "network-vif-plugged", "status": "completed", "tag": "b6a42460-29f0-496d-a7ba-d7ae2259f317"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-a7b023d1-deaf-4b97-84b9-7224f5decd67 req-5334616e-f953-4b34-971d-401c6930224b service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-a7b023d1-deaf-4b97-84b9-7224f5decd67 req-5334616e-f953-4b34-971d-401c6930224b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-a7b023d1-deaf-4b97-84b9-7224f5decd67 req-5334616e-f953-4b34-971d-401c6930224b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:02 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-a7b023d1-deaf-4b97-84b9-7224f5decd67 req-5334616e-f953-4b34-971d-401c6930224b service nova] Creating event network-vif-plugged:b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance 179b6945-589d-402c-a89e-6b8d68725211 on user Apr 13 15:09:02 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-a7b023d1-deaf-4b97-84b9-7224f5decd67 req-5334616e-f953-4b34-971d-401c6930224b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032675 Apr 13 15:09:02 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 48/141] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:09:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:04 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-9947ac58-b684-4167-926f-1bad4dd432a3 req-c9efbd33-d5a2-44de-9dee-f14b5566d543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179b6945-589d-402c-a89e-6b8d68725211", "name": "network-vif-plugged", "status": "completed", "tag": "b6a42460-29f0-496d-a7ba-d7ae2259f317"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-9947ac58-b684-4167-926f-1bad4dd432a3 req-c9efbd33-d5a2-44de-9dee-f14b5566d543 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-9947ac58-b684-4167-926f-1bad4dd432a3 req-c9efbd33-d5a2-44de-9dee-f14b5566d543 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-9947ac58-b684-4167-926f-1bad4dd432a3 req-c9efbd33-d5a2-44de-9dee-f14b5566d543 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:04 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-9947ac58-b684-4167-926f-1bad4dd432a3 req-c9efbd33-d5a2-44de-9dee-f14b5566d543 service nova] Creating event network-vif-plugged:b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance 179b6945-589d-402c-a89e-6b8d68725211 on user Apr 13 15:09:04 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-9947ac58-b684-4167-926f-1bad4dd432a3 req-c9efbd33-d5a2-44de-9dee-f14b5566d543 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032604 Apr 13 15:09:04 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 47/142] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:09:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:14 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-25e5f6f8-c3ce-4774-92b0-e49b28252ccc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:09:14 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-25e5f6f8-c3ce-4774-92b0-e49b28252ccc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:14 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:09:14 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:09:14 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:09:14 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=19 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:09:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-25e5f6f8-c3ce-4774-92b0-e49b28252ccc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-25e5f6f8-c3ce-4774-92b0-e49b28252ccc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-25e5f6f8-c3ce-4774-92b0-e49b28252ccc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-25e5f6f8-c3ce-4774-92b0-e49b28252ccc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-25e5f6f8-c3ce-4774-92b0-e49b28252ccc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-25e5f6f8-c3ce-4774-92b0-e49b28252ccc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:14 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-25e5f6f8-c3ce-4774-92b0-e49b28252ccc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c18c8a515b457088a9901fbc86629f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd530eb6a4bf04f468299323520f56d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:09:14 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-25e5f6f8-c3ce-4774-92b0-e49b28252ccc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40c18c8a515b457088a9901fbc86629f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd530eb6a4bf04f468299323520f56d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:09:14 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-25e5f6f8-c3ce-4774-92b0-e49b28252ccc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40c18c8a515b457088a9901fbc86629f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd530eb6a4bf04f468299323520f56d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:09:14 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-25e5f6f8-c3ce-4774-92b0-e49b28252ccc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944" status: 200 len: 2821 microversion: 2.32 time: 0.243923 Apr 13 15:09:14 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 48/143] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:09:14 2023] GET /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944 => generated 2821 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:09:18 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:09:18 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=3 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:09:18 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:09:18 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c02fb78a-5179-4ed7-b0a3-4798f27a7563"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:18 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:19 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] 10.0.0.210 "POST /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.554404 Apr 13 15:09:19 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 49/144] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:09:18 2023] POST /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5/os-volume_attachments => generated 194 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:19 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=3 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:09:19 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=23 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:09:19 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:19 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:19 user devstack@n-api.service[61872]: DEBUG nova.objects.instance [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'flavor' on Instance uuid 25f57234-8818-44d3-b476-d6cfba7b2810 {{(pid=61872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:09:19 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "POST /compute/v2.1/servers/25f57234-8818-44d3-b476-d6cfba7b2810/action" status: 200 len: 32 microversion: 2.1 time: 0.285962 Apr 13 15:09:19 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 48/145] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:09:19 2023] POST /compute/v2.1/servers/25f57234-8818-44d3-b476-d6cfba7b2810/action => generated 32 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:09:19 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-b7a48018-acd7-4ba2-a41c-5482978377ed tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:09:19 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-b7a48018-acd7-4ba2-a41c-5482978377ed tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b7a48018-acd7-4ba2-a41c-5482978377ed tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b7a48018-acd7-4ba2-a41c-5482978377ed tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b7a48018-acd7-4ba2-a41c-5482978377ed tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b7a48018-acd7-4ba2-a41c-5482978377ed tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b7a48018-acd7-4ba2-a41c-5482978377ed tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b7a48018-acd7-4ba2-a41c-5482978377ed tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:19 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-b7a48018-acd7-4ba2-a41c-5482978377ed tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:09:19 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-b7a48018-acd7-4ba2-a41c-5482978377ed tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25f57234-8818-44d3-b476-d6cfba7b2810" status: 200 len: 1509 microversion: 2.1 time: 0.314428 Apr 13 15:09:19 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 49/146] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:09:19 2023] GET /compute/v2.1/servers/25f57234-8818-44d3-b476-d6cfba7b2810 => generated 1509 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:09:21 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-fa1dad82-a811-425f-bd3c-e6fc63a5617e req-8dfa23e2-73f1-4bf8-8156-dd1a12bac40b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f57234-8818-44d3-b476-d6cfba7b2810", "name": "network-vif-unplugged", "status": "completed", "tag": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-fa1dad82-a811-425f-bd3c-e6fc63a5617e req-8dfa23e2-73f1-4bf8-8156-dd1a12bac40b service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-fa1dad82-a811-425f-bd3c-e6fc63a5617e req-8dfa23e2-73f1-4bf8-8156-dd1a12bac40b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-fa1dad82-a811-425f-bd3c-e6fc63a5617e req-8dfa23e2-73f1-4bf8-8156-dd1a12bac40b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:21 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-fa1dad82-a811-425f-bd3c-e6fc63a5617e req-8dfa23e2-73f1-4bf8-8156-dd1a12bac40b service nova] Creating event network-vif-unplugged:e4b886a7-88e3-42e3-98b8-b0fa9d67391a for instance 25f57234-8818-44d3-b476-d6cfba7b2810 on user Apr 13 15:09:21 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-fa1dad82-a811-425f-bd3c-e6fc63a5617e req-8dfa23e2-73f1-4bf8-8156-dd1a12bac40b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043294 Apr 13 15:09:21 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 50/147] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:09:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:23 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-0ba0a86b-6287-41d4-84eb-012acecfaf45 req-446cfb3f-227a-4e12-9f69-828e1c06cf5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f57234-8818-44d3-b476-d6cfba7b2810", "name": "network-vif-plugged", "status": "completed", "tag": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-0ba0a86b-6287-41d4-84eb-012acecfaf45 req-446cfb3f-227a-4e12-9f69-828e1c06cf5b service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-0ba0a86b-6287-41d4-84eb-012acecfaf45 req-446cfb3f-227a-4e12-9f69-828e1c06cf5b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-0ba0a86b-6287-41d4-84eb-012acecfaf45 req-446cfb3f-227a-4e12-9f69-828e1c06cf5b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:23 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-0ba0a86b-6287-41d4-84eb-012acecfaf45 req-446cfb3f-227a-4e12-9f69-828e1c06cf5b service nova] Creating event network-vif-plugged:e4b886a7-88e3-42e3-98b8-b0fa9d67391a for instance 25f57234-8818-44d3-b476-d6cfba7b2810 on user Apr 13 15:09:23 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-0ba0a86b-6287-41d4-84eb-012acecfaf45 req-446cfb3f-227a-4e12-9f69-828e1c06cf5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041234 Apr 13 15:09:23 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 49/148] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:09:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:25 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-2069430691"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:25 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:25 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-25b44ee9-7d93-4505-870f-b79b7879dd40 req-bbc0b30f-910f-470c-b6f2-9f62be59cc2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f57234-8818-44d3-b476-d6cfba7b2810", "name": "network-vif-plugged", "status": "completed", "tag": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a"}, {"server_uuid": "25f57234-8818-44d3-b476-d6cfba7b2810", "name": "network-vif-plugged", "status": "completed", "tag": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-25b44ee9-7d93-4505-870f-b79b7879dd40 req-bbc0b30f-910f-470c-b6f2-9f62be59cc2c service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-25b44ee9-7d93-4505-870f-b79b7879dd40 req-bbc0b30f-910f-470c-b6f2-9f62be59cc2c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-25b44ee9-7d93-4505-870f-b79b7879dd40 req-bbc0b30f-910f-470c-b6f2-9f62be59cc2c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:25 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-25b44ee9-7d93-4505-870f-b79b7879dd40 req-bbc0b30f-910f-470c-b6f2-9f62be59cc2c service nova] Creating event network-vif-plugged:e4b886a7-88e3-42e3-98b8-b0fa9d67391a for instance 25f57234-8818-44d3-b476-d6cfba7b2810 on user Apr 13 15:09:25 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-25b44ee9-7d93-4505-870f-b79b7879dd40 req-bbc0b30f-910f-470c-b6f2-9f62be59cc2c service nova] Creating event network-vif-plugged:e4b886a7-88e3-42e3-98b8-b0fa9d67391a for instance 25f57234-8818-44d3-b476-d6cfba7b2810 on user Apr 13 15:09:25 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-25b44ee9-7d93-4505-870f-b79b7879dd40 req-bbc0b30f-910f-470c-b6f2-9f62be59cc2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032875 Apr 13 15:09:25 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 51/149] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:09:25 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:26 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "POST /compute/v2.1/servers/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/action" status: 202 len: 52 microversion: 2.87 time: 1.016905 Apr 13 15:09:26 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 50/150] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 15:09:25 2023] POST /compute/v2.1/servers/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/action => generated 52 bytes in 1019 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 13 15:09:26 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:09:26 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:26 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Going to try to terminate instance {{(pid=61872) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:09:26 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5" status: 204 len: 0 microversion: 2.1 time: 0.125542 Apr 13 15:09:26 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 50/151] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:09:26 2023] DELETE /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 13 15:09:26 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-3a892ba0-5e88-4538-82d6-3e84d7408f38 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:09:26 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-3a892ba0-5e88-4538-82d6-3e84d7408f38 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-3a892ba0-5e88-4538-82d6-3e84d7408f38 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-3a892ba0-5e88-4538-82d6-3e84d7408f38 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-3a892ba0-5e88-4538-82d6-3e84d7408f38 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-3a892ba0-5e88-4538-82d6-3e84d7408f38 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-3a892ba0-5e88-4538-82d6-3e84d7408f38 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-3a892ba0-5e88-4538-82d6-3e84d7408f38 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:27 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-73ee5bdd-c33d-45c6-b040-03c7f796ce0e req-3fdc5ffe-e7da-4921-b070-af77813ee34d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a0788e-df82-4c1e-97dd-1d246048afc5", "name": "network-vif-unplugged", "status": "completed", "tag": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:27 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-73ee5bdd-c33d-45c6-b040-03c7f796ce0e req-3fdc5ffe-e7da-4921-b070-af77813ee34d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:27 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-73ee5bdd-c33d-45c6-b040-03c7f796ce0e req-3fdc5ffe-e7da-4921-b070-af77813ee34d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:27 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-73ee5bdd-c33d-45c6-b040-03c7f796ce0e req-3fdc5ffe-e7da-4921-b070-af77813ee34d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:27 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-73ee5bdd-c33d-45c6-b040-03c7f796ce0e req-3fdc5ffe-e7da-4921-b070-af77813ee34d service nova] Creating event network-vif-unplugged:393596c3-b6ee-4d5e-bec9-d9e96b9bf93f for instance 58a0788e-df82-4c1e-97dd-1d246048afc5 on user Apr 13 15:09:27 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-73ee5bdd-c33d-45c6-b040-03c7f796ce0e req-3fdc5ffe-e7da-4921-b070-af77813ee34d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036569 Apr 13 15:09:27 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 51/152] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:09:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:27 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-3a892ba0-5e88-4538-82d6-3e84d7408f38 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844897ef27d4395af0a8f069699ce4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62589c1782f2473ead9b4270af3982f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:09:27 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-3a892ba0-5e88-4538-82d6-3e84d7408f38 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5" status: 200 len: 1539 microversion: 2.1 time: 0.471223 Apr 13 15:09:27 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 52/153] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:09:26 2023] GET /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5 => generated 1539 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:09:29 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-2394249f-55cd-49d6-baa1-b6c1188e0035 req-86e308ca-56ae-45a4-ad39-05410616082c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a0788e-df82-4c1e-97dd-1d246048afc5", "name": "network-vif-deleted", "tag": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:29 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-2394249f-55cd-49d6-baa1-b6c1188e0035 req-86e308ca-56ae-45a4-ad39-05410616082c service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:29 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-2394249f-55cd-49d6-baa1-b6c1188e0035 req-86e308ca-56ae-45a4-ad39-05410616082c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:29 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-2394249f-55cd-49d6-baa1-b6c1188e0035 req-86e308ca-56ae-45a4-ad39-05410616082c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:29 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-2394249f-55cd-49d6-baa1-b6c1188e0035 req-86e308ca-56ae-45a4-ad39-05410616082c service nova] Creating event network-vif-deleted:393596c3-b6ee-4d5e-bec9-d9e96b9bf93f for instance 58a0788e-df82-4c1e-97dd-1d246048afc5 on user Apr 13 15:09:29 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-184ea57d-6683-4fc4-9291-874975bf7dd0 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:09:29 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-184ea57d-6683-4fc4-9291-874975bf7dd0 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:29 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-2394249f-55cd-49d6-baa1-b6c1188e0035 req-86e308ca-56ae-45a4-ad39-05410616082c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039883 Apr 13 15:09:29 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 51/154] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:09:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-184ea57d-6683-4fc4-9291-874975bf7dd0 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-184ea57d-6683-4fc4-9291-874975bf7dd0 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-184ea57d-6683-4fc4-9291-874975bf7dd0 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-184ea57d-6683-4fc4-9291-874975bf7dd0 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-184ea57d-6683-4fc4-9291-874975bf7dd0 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-184ea57d-6683-4fc4-9291-874975bf7dd0 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:29 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-184ea57d-6683-4fc4-9291-874975bf7dd0 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.122933 Apr 13 15:09:29 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 52/155] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 15:09:29 2023] GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818/os-interface => generated 282 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:29 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-3f1626fa-53c0-499f-a3bb-c7baf248b596 req-5abe2b59-0ff5-447a-80d5-91bd4e9cdcd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a0788e-df82-4c1e-97dd-1d246048afc5", "name": "network-vif-plugged", "status": "completed", "tag": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:29 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3f1626fa-53c0-499f-a3bb-c7baf248b596 req-5abe2b59-0ff5-447a-80d5-91bd4e9cdcd9 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:29 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3f1626fa-53c0-499f-a3bb-c7baf248b596 req-5abe2b59-0ff5-447a-80d5-91bd4e9cdcd9 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:29 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3f1626fa-53c0-499f-a3bb-c7baf248b596 req-5abe2b59-0ff5-447a-80d5-91bd4e9cdcd9 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:29 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-3f1626fa-53c0-499f-a3bb-c7baf248b596 req-5abe2b59-0ff5-447a-80d5-91bd4e9cdcd9 service nova] Creating event network-vif-plugged:393596c3-b6ee-4d5e-bec9-d9e96b9bf93f for instance 58a0788e-df82-4c1e-97dd-1d246048afc5 on user Apr 13 15:09:29 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-3f1626fa-53c0-499f-a3bb-c7baf248b596 req-5abe2b59-0ff5-447a-80d5-91bd4e9cdcd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038598 Apr 13 15:09:29 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 53/156] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:09:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:31 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-2101845870"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:31 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:31 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:31 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:31 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:31 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:31 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:31 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:31 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-a9a80a3d-6361-4b11-ad4a-eca1707fd252 req-593e2a71-196a-4650-bf27-3f8eb2b2e9fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a9a80a3d-6361-4b11-ad4a-eca1707fd252 req-593e2a71-196a-4650-bf27-3f8eb2b2e9fd service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a9a80a3d-6361-4b11-ad4a-eca1707fd252 req-593e2a71-196a-4650-bf27-3f8eb2b2e9fd service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a9a80a3d-6361-4b11-ad4a-eca1707fd252 req-593e2a71-196a-4650-bf27-3f8eb2b2e9fd service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:31 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-a9a80a3d-6361-4b11-ad4a-eca1707fd252 req-593e2a71-196a-4650-bf27-3f8eb2b2e9fd service nova] Creating event network-changed:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:09:31 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-a9a80a3d-6361-4b11-ad4a-eca1707fd252 req-593e2a71-196a-4650-bf27-3f8eb2b2e9fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035408 Apr 13 15:09:31 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 53/157] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:09:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:32 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "POST /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818/action" status: 202 len: 0 microversion: 2.1 time: 1.080893 Apr 13 15:09:32 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 52/158] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:09:31 2023] POST /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818/action => generated 0 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 449 bytes (2 switches on core 0) Apr 13 15:09:32 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-b94ad730-f6c5-4bfb-9f8a-86896d729b51 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Calling method '.version_select at 0x7f3a8be3e7a0>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:09:32 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-b94ad730-f6c5-4bfb-9f8a-86896d729b51 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "GET /compute/v2.1/images/b09d887d-e4fc-48c4-a1b4-8c026c0de9fc" status: 200 len: 1609 microversion: 2.1 time: 0.065734 Apr 13 15:09:32 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 54/159] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 15:09:32 2023] GET /compute/v2.1/images/b09d887d-e4fc-48c4-a1b4-8c026c0de9fc => generated 1609 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:09:32 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-19e260e5-2355-4d2c-b886-c08e85aaa53c tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:09:32 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-19e260e5-2355-4d2c-b886-c08e85aaa53c tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-19e260e5-2355-4d2c-b886-c08e85aaa53c tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-19e260e5-2355-4d2c-b886-c08e85aaa53c tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-19e260e5-2355-4d2c-b886-c08e85aaa53c tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-19e260e5-2355-4d2c-b886-c08e85aaa53c tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-19e260e5-2355-4d2c-b886-c08e85aaa53c tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-19e260e5-2355-4d2c-b886-c08e85aaa53c tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:32 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-19e260e5-2355-4d2c-b886-c08e85aaa53c tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:09:32 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-19e260e5-2355-4d2c-b886-c08e85aaa53c tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:09:32 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-19e260e5-2355-4d2c-b886-c08e85aaa53c tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:09:32 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-19e260e5-2355-4d2c-b886-c08e85aaa53c tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" status: 200 len: 1690 microversion: 2.87 time: 0.261849 Apr 13 15:09:32 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 54/160] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:09:32 2023] GET /compute/v2.1/servers/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba => generated 1690 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:09:43 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:09:43 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:09:43 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-b6801fcc-9a0a-4dd0-a259-6d58965ecbfd tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:09:43 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-b6801fcc-9a0a-4dd0-a259-6d58965ecbfd tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:43 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b6801fcc-9a0a-4dd0-a259-6d58965ecbfd tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:43 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b6801fcc-9a0a-4dd0-a259-6d58965ecbfd tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:43 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b6801fcc-9a0a-4dd0-a259-6d58965ecbfd tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:43 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b6801fcc-9a0a-4dd0-a259-6d58965ecbfd tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:43 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b6801fcc-9a0a-4dd0-a259-6d58965ecbfd tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:43 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b6801fcc-9a0a-4dd0-a259-6d58965ecbfd tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:43 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-b6801fcc-9a0a-4dd0-a259-6d58965ecbfd tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc0cce3df7540078438186f46ca4621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7227559570b54e92be19d25938523b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:09:43 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-b6801fcc-9a0a-4dd0-a259-6d58965ecbfd tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211" status: 200 len: 1433 microversion: 2.1 time: 0.158667 Apr 13 15:09:43 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 53/161] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:09:43 2023] GET /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211 => generated 1433 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:09:44 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=10 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:09:44 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:09:44 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:09:44 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:44 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:44 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:44 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:44 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:44 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:44 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:44 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Going to try to terminate instance {{(pid=61873) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:09:44 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/63f69337-7ae4-4125-a560-f6cbcb2298d4" status: 204 len: 0 microversion: 2.1 time: 0.143118 Apr 13 15:09:44 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 55/162] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:09:44 2023] DELETE /compute/v2.1/servers/63f69337-7ae4-4125-a560-f6cbcb2298d4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:09:44 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-7f564f1d-4ff2-4137-ac0f-9200eda9fd3a tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:09:44 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-7f564f1d-4ff2-4137-ac0f-9200eda9fd3a tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:44 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:09:44 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=16 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:09:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7f564f1d-4ff2-4137-ac0f-9200eda9fd3a tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7f564f1d-4ff2-4137-ac0f-9200eda9fd3a tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7f564f1d-4ff2-4137-ac0f-9200eda9fd3a tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7f564f1d-4ff2-4137-ac0f-9200eda9fd3a tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7f564f1d-4ff2-4137-ac0f-9200eda9fd3a tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7f564f1d-4ff2-4137-ac0f-9200eda9fd3a tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:44 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-b355d551-7e34-431d-a5be-dcbbf27f33b2 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:09:44 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-b355d551-7e34-431d-a5be-dcbbf27f33b2 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b355d551-7e34-431d-a5be-dcbbf27f33b2 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b355d551-7e34-431d-a5be-dcbbf27f33b2 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b355d551-7e34-431d-a5be-dcbbf27f33b2 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b355d551-7e34-431d-a5be-dcbbf27f33b2 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b355d551-7e34-431d-a5be-dcbbf27f33b2 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b355d551-7e34-431d-a5be-dcbbf27f33b2 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:44 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-b355d551-7e34-431d-a5be-dcbbf27f33b2 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.103785 Apr 13 15:09:44 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 54/163] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 15:09:44 2023] GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9/os-interface => generated 283 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:44 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-7f564f1d-4ff2-4137-ac0f-9200eda9fd3a tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8adc8b289e548a5ac16b6356753d6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c1b992977a479883e445330b3d0d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:09:44 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-7f564f1d-4ff2-4137-ac0f-9200eda9fd3a tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] 10.0.0.210 "GET /compute/v2.1/servers/63f69337-7ae4-4125-a560-f6cbcb2298d4" status: 200 len: 1460 microversion: 2.1 time: 0.283995 Apr 13 15:09:44 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 55/164] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:09:44 2023] GET /compute/v2.1/servers/63f69337-7ae4-4125-a560-f6cbcb2298d4 => generated 1460 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 15:09:44 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-862e9a73-55bd-49e8-b0d9-193d9f2e81c7 req-83347ebf-9403-4288-84ea-5c7aed69d9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f69337-7ae4-4125-a560-f6cbcb2298d4", "name": "network-vif-unplugged", "status": "completed", "tag": "f1e3287f-407f-49f2-8d91-881e31471ee9"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:44 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-862e9a73-55bd-49e8-b0d9-193d9f2e81c7 req-83347ebf-9403-4288-84ea-5c7aed69d9a5 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:44 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-862e9a73-55bd-49e8-b0d9-193d9f2e81c7 req-83347ebf-9403-4288-84ea-5c7aed69d9a5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:44 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-862e9a73-55bd-49e8-b0d9-193d9f2e81c7 req-83347ebf-9403-4288-84ea-5c7aed69d9a5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:44 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-862e9a73-55bd-49e8-b0d9-193d9f2e81c7 req-83347ebf-9403-4288-84ea-5c7aed69d9a5 service nova] Creating event network-vif-unplugged:f1e3287f-407f-49f2-8d91-881e31471ee9 for instance 63f69337-7ae4-4125-a560-f6cbcb2298d4 on user Apr 13 15:09:44 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-862e9a73-55bd-49e8-b0d9-193d9f2e81c7 req-83347ebf-9403-4288-84ea-5c7aed69d9a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033450 Apr 13 15:09:44 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 56/165] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:09:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:45 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-74b19886-1e47-4554-bd2f-603ddee5ae94 req-4fa993c1-3f09-4594-ae59-eec3be7e45d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "051e6c4e-3d10-4b43-9099-7abffd84d0d9", "tag": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-74b19886-1e47-4554-bd2f-603ddee5ae94 req-4fa993c1-3f09-4594-ae59-eec3be7e45d1 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-74b19886-1e47-4554-bd2f-603ddee5ae94 req-4fa993c1-3f09-4594-ae59-eec3be7e45d1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-74b19886-1e47-4554-bd2f-603ddee5ae94 req-4fa993c1-3f09-4594-ae59-eec3be7e45d1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:45 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-74b19886-1e47-4554-bd2f-603ddee5ae94 req-4fa993c1-3f09-4594-ae59-eec3be7e45d1 service nova] Creating event network-changed:a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f for instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 on user Apr 13 15:09:45 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-74b19886-1e47-4554-bd2f-603ddee5ae94 req-4fa993c1-3f09-4594-ae59-eec3be7e45d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031743 Apr 13 15:09:45 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 55/166] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:09:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:45 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-ab800df8-4cc4-4ee0-84ac-2444730830e3 req-5a4a6e15-2aff-4d18-836a-113d97b86d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f69337-7ae4-4125-a560-f6cbcb2298d4", "name": "network-vif-deleted", "tag": "f1e3287f-407f-49f2-8d91-881e31471ee9"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:45 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ab800df8-4cc4-4ee0-84ac-2444730830e3 req-5a4a6e15-2aff-4d18-836a-113d97b86d88 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:45 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ab800df8-4cc4-4ee0-84ac-2444730830e3 req-5a4a6e15-2aff-4d18-836a-113d97b86d88 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:45 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ab800df8-4cc4-4ee0-84ac-2444730830e3 req-5a4a6e15-2aff-4d18-836a-113d97b86d88 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:45 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-ab800df8-4cc4-4ee0-84ac-2444730830e3 req-5a4a6e15-2aff-4d18-836a-113d97b86d88 service nova] Creating event network-vif-deleted:f1e3287f-407f-49f2-8d91-881e31471ee9 for instance 63f69337-7ae4-4125-a560-f6cbcb2298d4 on user Apr 13 15:09:45 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-ab800df8-4cc4-4ee0-84ac-2444730830e3 req-5a4a6e15-2aff-4d18-836a-113d97b86d88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036335 Apr 13 15:09:45 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 56/167] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:09:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:46 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-e5df35ea-9e55-4cd4-9afc-f080728207f2 req-505b0af8-50f3-4712-a542-3fba9012b48f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f69337-7ae4-4125-a560-f6cbcb2298d4", "name": "network-vif-plugged", "status": "completed", "tag": "f1e3287f-407f-49f2-8d91-881e31471ee9"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:46 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-e5df35ea-9e55-4cd4-9afc-f080728207f2 req-505b0af8-50f3-4712-a542-3fba9012b48f service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:46 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-e5df35ea-9e55-4cd4-9afc-f080728207f2 req-505b0af8-50f3-4712-a542-3fba9012b48f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:46 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-e5df35ea-9e55-4cd4-9afc-f080728207f2 req-505b0af8-50f3-4712-a542-3fba9012b48f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:46 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-e5df35ea-9e55-4cd4-9afc-f080728207f2 req-505b0af8-50f3-4712-a542-3fba9012b48f service nova] Creating event network-vif-plugged:f1e3287f-407f-49f2-8d91-881e31471ee9 for instance 63f69337-7ae4-4125-a560-f6cbcb2298d4 on user Apr 13 15:09:46 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-e5df35ea-9e55-4cd4-9afc-f080728207f2 req-505b0af8-50f3-4712-a542-3fba9012b48f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034383 Apr 13 15:09:46 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 57/168] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:09:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:46 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1149929-63dc-4bc4-addf-053acb5ebe92"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:46 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:47 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] 10.0.0.210 "POST /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298983 Apr 13 15:09:47 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 56/169] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:09:46 2023] POST /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:50 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-852e4fee-f6ea-4edc-b794-0a6320f5ea87 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:09:50 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-852e4fee-f6ea-4edc-b794-0a6320f5ea87 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-852e4fee-f6ea-4edc-b794-0a6320f5ea87 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-852e4fee-f6ea-4edc-b794-0a6320f5ea87 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-852e4fee-f6ea-4edc-b794-0a6320f5ea87 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-852e4fee-f6ea-4edc-b794-0a6320f5ea87 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-852e4fee-f6ea-4edc-b794-0a6320f5ea87 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-852e4fee-f6ea-4edc-b794-0a6320f5ea87 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:50 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-852e4fee-f6ea-4edc-b794-0a6320f5ea87 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.087264 Apr 13 15:09:50 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 57/170] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 15:09:50 2023] GET /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719/os-interface => generated 282 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:51 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-3a90f499-ac15-4527-b293-10360495b979 req-a61bd26a-e7b3-4c04-b336-e260bcc0f3cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be0a3f9-0dae-4739-9f1e-0bb416a97719", "tag": "daee05dc-ae07-4d68-94f3-7c2ee8039327"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3a90f499-ac15-4527-b293-10360495b979 req-a61bd26a-e7b3-4c04-b336-e260bcc0f3cf service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3a90f499-ac15-4527-b293-10360495b979 req-a61bd26a-e7b3-4c04-b336-e260bcc0f3cf service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3a90f499-ac15-4527-b293-10360495b979 req-a61bd26a-e7b3-4c04-b336-e260bcc0f3cf service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:51 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-3a90f499-ac15-4527-b293-10360495b979 req-a61bd26a-e7b3-4c04-b336-e260bcc0f3cf service nova] Creating event network-changed:daee05dc-ae07-4d68-94f3-7c2ee8039327 for instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 on user Apr 13 15:09:51 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-3a90f499-ac15-4527-b293-10360495b979 req-a61bd26a-e7b3-4c04-b336-e260bcc0f3cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028522 Apr 13 15:09:51 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 58/171] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:09:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:53 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6ada0a7-ffdb-481e-a557-ba3dec80ef65"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:53 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:53 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311366 Apr 13 15:09:53 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 57/172] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:09:53 2023] POST /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:53 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-e032dfb1-a496-4bfb-8b92-e0e3e967cbbb tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:09:53 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-e032dfb1-a496-4bfb-8b92-e0e3e967cbbb tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e032dfb1-a496-4bfb-8b92-e0e3e967cbbb tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e032dfb1-a496-4bfb-8b92-e0e3e967cbbb tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e032dfb1-a496-4bfb-8b92-e0e3e967cbbb tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e032dfb1-a496-4bfb-8b92-e0e3e967cbbb tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e032dfb1-a496-4bfb-8b92-e0e3e967cbbb tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e032dfb1-a496-4bfb-8b92-e0e3e967cbbb tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:53 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-e032dfb1-a496-4bfb-8b92-e0e3e967cbbb tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] 10.0.0.210 "GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.102727 Apr 13 15:09:53 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 58/173] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 15:09:53 2023] GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-interface => generated 282 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:54 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c5d55283-149c-4ef5-8797-dc8b1c7aa21d tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:09:54 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-c5d55283-149c-4ef5-8797-dc8b1c7aa21d tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:54 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c5d55283-149c-4ef5-8797-dc8b1c7aa21d tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:54 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c5d55283-149c-4ef5-8797-dc8b1c7aa21d tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:54 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c5d55283-149c-4ef5-8797-dc8b1c7aa21d tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:54 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c5d55283-149c-4ef5-8797-dc8b1c7aa21d tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:54 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c5d55283-149c-4ef5-8797-dc8b1c7aa21d tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:54 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c5d55283-149c-4ef5-8797-dc8b1c7aa21d tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:54 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-c5d55283-149c-4ef5-8797-dc8b1c7aa21d tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046505 Apr 13 15:09:54 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 59/174] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:09:54 2023] GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:54 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:09:54 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:54 user devstack@n-api.service[61872]: DEBUG nova.objects.instance [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lazy-loading 'services' on Instance uuid 051e6c4e-3d10-4b43-9099-7abffd84d0d9 {{(pid=61872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:09:54 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-c9d44aa8-e73c-4f61-9e82-2bd897927642 req-b5f47b73-0f01-41fa-9e41-bd80117b320a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "193136fc-e6c3-4e70-b7ab-01ced440c6bd", "tag": "49eab8a0-3140-4872-b606-e03f2a243e2f"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c9d44aa8-e73c-4f61-9e82-2bd897927642 req-b5f47b73-0f01-41fa-9e41-bd80117b320a service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c9d44aa8-e73c-4f61-9e82-2bd897927642 req-b5f47b73-0f01-41fa-9e41-bd80117b320a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c9d44aa8-e73c-4f61-9e82-2bd897927642 req-b5f47b73-0f01-41fa-9e41-bd80117b320a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:55 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-c9d44aa8-e73c-4f61-9e82-2bd897927642 req-b5f47b73-0f01-41fa-9e41-bd80117b320a service nova] Creating event network-changed:49eab8a0-3140-4872-b606-e03f2a243e2f for instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd on user Apr 13 15:09:55 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-c9d44aa8-e73c-4f61-9e82-2bd897927642 req-b5f47b73-0f01-41fa-9e41-bd80117b320a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046476 Apr 13 15:09:55 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 59/175] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:09:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:55 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9/os-volume_attachments/c1149929-63dc-4bc4-addf-053acb5ebe92" status: 202 len: 0 microversion: 2.1 time: 0.273170 Apr 13 15:09:55 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 58/176] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:09:54 2023] DELETE /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9/os-volume_attachments/c1149929-63dc-4bc4-addf-053acb5ebe92 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:09:55 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c648678-ad4b-4ce5-b267-ebf3abef2c5d"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:55 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:55 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] 10.0.0.210 "POST /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329378 Apr 13 15:09:55 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 60/177] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:09:55 2023] POST /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:57 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c26a7475-65be-4746-a265-5e7602c05128 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:09:57 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-c26a7475-65be-4746-a265-5e7602c05128 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c26a7475-65be-4746-a265-5e7602c05128 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c26a7475-65be-4746-a265-5e7602c05128 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c26a7475-65be-4746-a265-5e7602c05128 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c26a7475-65be-4746-a265-5e7602c05128 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c26a7475-65be-4746-a265-5e7602c05128 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c26a7475-65be-4746-a265-5e7602c05128 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:57 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-c26a7475-65be-4746-a265-5e7602c05128 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.091690 Apr 13 15:09:57 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 60/178] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 15:09:57 2023] GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/os-interface => generated 283 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:09:58 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-8c00650a-3e08-4317-8d70-c260166209e5 req-ec159133-b7eb-4ddd-8d31-7e85940f6f7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc", "tag": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-8c00650a-3e08-4317-8d70-c260166209e5 req-ec159133-b7eb-4ddd-8d31-7e85940f6f7b service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-8c00650a-3e08-4317-8d70-c260166209e5 req-ec159133-b7eb-4ddd-8d31-7e85940f6f7b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-8c00650a-3e08-4317-8d70-c260166209e5 req-ec159133-b7eb-4ddd-8d31-7e85940f6f7b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:58 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-8c00650a-3e08-4317-8d70-c260166209e5 req-ec159133-b7eb-4ddd-8d31-7e85940f6f7b service nova] Creating event network-changed:ce8e302f-1f0b-46e0-82ef-9809a6ad81db for instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc on user Apr 13 15:09:58 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-8c00650a-3e08-4317-8d70-c260166209e5 req-ec159133-b7eb-4ddd-8d31-7e85940f6f7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035128 Apr 13 15:09:58 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 59/179] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:09:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:09:58 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-33934058-2bd1-43b1-a773-d43edd2b8b06 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:09:58 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-33934058-2bd1-43b1-a773-d43edd2b8b06 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-33934058-2bd1-43b1-a773-d43edd2b8b06 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-33934058-2bd1-43b1-a773-d43edd2b8b06 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-33934058-2bd1-43b1-a773-d43edd2b8b06 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-33934058-2bd1-43b1-a773-d43edd2b8b06 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-33934058-2bd1-43b1-a773-d43edd2b8b06 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-33934058-2bd1-43b1-a773-d43edd2b8b06 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:58 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-33934058-2bd1-43b1-a773-d43edd2b8b06 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b59f4d6492a4821a621b18766bf58fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23bf27d7ed4f0abf2fdc60ae1edb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:09:58 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-33934058-2bd1-43b1-a773-d43edd2b8b06 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b59f4d6492a4821a621b18766bf58fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23bf27d7ed4f0abf2fdc60ae1edb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:09:58 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-33934058-2bd1-43b1-a773-d43edd2b8b06 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b59f4d6492a4821a621b18766bf58fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23bf27d7ed4f0abf2fdc60ae1edb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:09:58 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-33934058-2bd1-43b1-a773-d43edd2b8b06 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" status: 200 len: 1629 microversion: 2.49 time: 0.507977 Apr 13 15:09:58 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 61/180] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:09:58 2023] GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc => generated 1629 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:09:58 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867", "tag": "nic-tag"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:09:58 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:09:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:09:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:09:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:09:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:00 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d4169f0b-668c-4493-aa72-56518595ed92 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "187dd08f-1695-4dc1-bce6-165c2c5137f2"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:00 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-d4169f0b-668c-4493-aa72-56518595ed92 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:00 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d4169f0b-668c-4493-aa72-56518595ed92 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:00 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d4169f0b-668c-4493-aa72-56518595ed92 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:00 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d4169f0b-668c-4493-aa72-56518595ed92 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:00 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d4169f0b-668c-4493-aa72-56518595ed92 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:00 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d4169f0b-668c-4493-aa72-56518595ed92 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:00 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d4169f0b-668c-4493-aa72-56518595ed92 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:00 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-fc50e0d4-bceb-437a-8e63-1775ed1080ca req-e1f6b439-6345-4932-a4b4-53d30ae2a08f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc", "tag": "f9729e1e-db88-4e50-bc31-f2ad9a568084"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-fc50e0d4-bceb-437a-8e63-1775ed1080ca req-e1f6b439-6345-4932-a4b4-53d30ae2a08f service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-fc50e0d4-bceb-437a-8e63-1775ed1080ca req-e1f6b439-6345-4932-a4b4-53d30ae2a08f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-fc50e0d4-bceb-437a-8e63-1775ed1080ca req-e1f6b439-6345-4932-a4b4-53d30ae2a08f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:00 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-fc50e0d4-bceb-437a-8e63-1775ed1080ca req-e1f6b439-6345-4932-a4b4-53d30ae2a08f service nova] Creating event network-changed:f9729e1e-db88-4e50-bc31-f2ad9a568084 for instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc on user Apr 13 15:10:00 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-fc50e0d4-bceb-437a-8e63-1775ed1080ca req-e1f6b439-6345-4932-a4b4-53d30ae2a08f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033346 Apr 13 15:10:00 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 62/181] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:00 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-d4169f0b-668c-4493-aa72-56518595ed92 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] HTTP exception thrown: Volume 187dd08f-1695-4dc1-bce6-165c2c5137f2 could not be found. Apr 13 15:10:00 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d4169f0b-668c-4493-aa72-56518595ed92 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] Request method failure captured: Apr 13 15:10:00 user devstack@n-api.service[61872]: request: PUT /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719/os-volume_attachments/d6ada0a7-ffdb-481e-a557-ba3dec80ef65 HTTP/1.1 Apr 13 15:10:00 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:10:00 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:10:00 user devstack@n-api.service[61872]: Connection: close Apr 13 15:10:00 user devstack@n-api.service[61872]: Content-Length: 74 Apr 13 15:10:00 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:10:00 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:10:00 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:10:00 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:10:00 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBrHAEPd9nB5JKkh9hv2LaFtaX8UqZb_a-lsoyz8_BlTYTgYVzy5zN0V63mlrhIQOmy8Xx1EioaJLpHrbiy7i7bckNnjx_tM3kmfvM0PN3G9BSTk4u8UF_r-pwevr698hxeMEn8EzefB6y-Y4VVhFRAoiA8pVQP0dLTKdOS6-VBOf5w Apr 13 15:10:00 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:10:00 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:10:00 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:10:00 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:10:00 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:10:00 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:10:00 user devstack@n-api.service[61872]: X-Project-Id: e00d15c7e1664a65958927d90ea1596c Apr 13 15:10:00 user devstack@n-api.service[61872]: X-Project-Name: tempest-VolumesAdminNegativeTest-160555478 Apr 13 15:10:00 user devstack@n-api.service[61872]: X-Role: member,reader,admin Apr 13 15:10:00 user devstack@n-api.service[61872]: X-Roles: member,reader,admin Apr 13 15:10:00 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e00d15c7e1664a65958927d90ea1596c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e00d15c7e1664a65958927d90ea1596c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e00d15c7e1664a65958927d90ea1596c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:10:00 user devstack@n-api.service[61872]: X-Tenant: tempest-VolumesAdminNegativeTest-160555478 Apr 13 15:10:00 user devstack@n-api.service[61872]: X-Tenant-Id: e00d15c7e1664a65958927d90ea1596c Apr 13 15:10:00 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-160555478 Apr 13 15:10:00 user devstack@n-api.service[61872]: X-User: tempest-VolumesAdminNegativeTest-160555478-project-admin Apr 13 15:10:00 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:10:00 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:10:00 user devstack@n-api.service[61872]: X-User-Id: 526e3daaeed7478cab39f71f3b7ac055 Apr 13 15:10:00 user devstack@n-api.service[61872]: X-User-Name: tempest-VolumesAdminNegativeTest-160555478-project-admin Apr 13 15:10:00 user devstack@n-api.service[61872]: Apr 13 15:10:00 user devstack@n-api.service[61872]: {"volumeAttachment": {"volumeId": "187dd08f-1695-4dc1-bce6-165c2c5137f2"}} Apr 13 15:10:00 user devstack@n-api.service[61872]: method: > Apr 13 15:10:00 user devstack@n-api.service[61872]: exception: Volume 187dd08f-1695-4dc1-bce6-165c2c5137f2 could not be found. Apr 13 15:10:00 user devstack@n-api.service[61872]: action_args: {'server_id': '1be0a3f9-0dae-4739-9f1e-0bb416a97719', 'id': 'd6ada0a7-ffdb-481e-a557-ba3dec80ef65', 'body': {'volumeAttachment': {'volumeId': '187dd08f-1695-4dc1-bce6-165c2c5137f2'}}} Apr 13 15:10:00 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 187dd08f-1695-4dc1-bce6-165c2c5137f2 could not be found. (HTTP 404) (Request-ID: req-d5578a30-fdca-4586-bde2-7fba9a38f4be) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 187dd08f-1695-4dc1-bce6-165c2c5137f2 could not be found. Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 187dd08f-1695-4dc1-bce6-165c2c5137f2 could not be found. Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 187dd08f-1695-4dc1-bce6-165c2c5137f2 could not be found. Apr 13 15:10:00 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:10:00 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d4169f0b-668c-4493-aa72-56518595ed92 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] Returning 400 to user: Volume 187dd08f-1695-4dc1-bce6-165c2c5137f2 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:10:00 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-d4169f0b-668c-4493-aa72-56518595ed92 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719/os-volume_attachments/d6ada0a7-ffdb-481e-a557-ba3dec80ef65" status: 400 len: 107 microversion: 2.1 time: 0.371743 Apr 13 15:10:00 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 60/182] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 15:10:00 2023] PUT /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719/os-volume_attachments/d6ada0a7-ffdb-481e-a557-ba3dec80ef65 => generated 107 bytes in 373 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:10:00 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:00 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG nova.objects.instance [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lazy-loading 'services' on Instance uuid 1be0a3f9-0dae-4739-9f1e-0bb416a97719 {{(pid=61873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:10:01 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719/os-volume_attachments/d6ada0a7-ffdb-481e-a557-ba3dec80ef65" status: 202 len: 0 microversion: 2.1 time: 0.275156 Apr 13 15:10:01 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 63/183] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:10:00 2023] DELETE /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719/os-volume_attachments/d6ada0a7-ffdb-481e-a557-ba3dec80ef65 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-01b1a474-0a80-4b9f-ad14-fd2f29e8c5b3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-01b1a474-0a80-4b9f-ad14-fd2f29e8c5b3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-01b1a474-0a80-4b9f-ad14-fd2f29e8c5b3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-01b1a474-0a80-4b9f-ad14-fd2f29e8c5b3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-01b1a474-0a80-4b9f-ad14-fd2f29e8c5b3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-01b1a474-0a80-4b9f-ad14-fd2f29e8c5b3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-01b1a474-0a80-4b9f-ad14-fd2f29e8c5b3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-01b1a474-0a80-4b9f-ad14-fd2f29e8c5b3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:01 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-01b1a474-0a80-4b9f-ad14-fd2f29e8c5b3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055519 Apr 13 15:10:01 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 61/184] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:10:01 2023] GET /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-45330c58-09ff-4049-bd5e-43dd2db84036 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-45330c58-09ff-4049-bd5e-43dd2db84036 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-45330c58-09ff-4049-bd5e-43dd2db84036 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-45330c58-09ff-4049-bd5e-43dd2db84036 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-45330c58-09ff-4049-bd5e-43dd2db84036 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-45330c58-09ff-4049-bd5e-43dd2db84036 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-45330c58-09ff-4049-bd5e-43dd2db84036 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-45330c58-09ff-4049-bd5e-43dd2db84036 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:01 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-45330c58-09ff-4049-bd5e-43dd2db84036 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046611 Apr 13 15:10:01 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 64/185] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:10:01 2023] GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-60b3cf28-fee5-4d7b-9660-d9c27d3db97a tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-60b3cf28-fee5-4d7b-9660-d9c27d3db97a tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-60b3cf28-fee5-4d7b-9660-d9c27d3db97a tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-60b3cf28-fee5-4d7b-9660-d9c27d3db97a tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-60b3cf28-fee5-4d7b-9660-d9c27d3db97a tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-60b3cf28-fee5-4d7b-9660-d9c27d3db97a tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-60b3cf28-fee5-4d7b-9660-d9c27d3db97a tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-60b3cf28-fee5-4d7b-9660-d9c27d3db97a tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:01 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-60b3cf28-fee5-4d7b-9660-d9c27d3db97a tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048921 Apr 13 15:10:01 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 62/186] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:10:01 2023] GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Going to try to terminate instance {{(pid=61873) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:10:01 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9" status: 204 len: 0 microversion: 2.1 time: 0.169795 Apr 13 15:10:01 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 65/187] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:10:01 2023] DELETE /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e1a13074-ac86-49c7-8ca9-fec9624fe2b2 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-e1a13074-ac86-49c7-8ca9-fec9624fe2b2 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e1a13074-ac86-49c7-8ca9-fec9624fe2b2 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e1a13074-ac86-49c7-8ca9-fec9624fe2b2 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e1a13074-ac86-49c7-8ca9-fec9624fe2b2 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e1a13074-ac86-49c7-8ca9-fec9624fe2b2 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e1a13074-ac86-49c7-8ca9-fec9624fe2b2 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e1a13074-ac86-49c7-8ca9-fec9624fe2b2 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-30193e3c-2bf9-4fb6-b972-514dbd793dc4 req-e3c4ab36-efc9-442d-9a07-9a7d63361b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc", "name": "network-vif-plugged", "status": "completed", "tag": "f9729e1e-db88-4e50-bc31-f2ad9a568084"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-30193e3c-2bf9-4fb6-b972-514dbd793dc4 req-e3c4ab36-efc9-442d-9a07-9a7d63361b22 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-30193e3c-2bf9-4fb6-b972-514dbd793dc4 req-e3c4ab36-efc9-442d-9a07-9a7d63361b22 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-30193e3c-2bf9-4fb6-b972-514dbd793dc4 req-e3c4ab36-efc9-442d-9a07-9a7d63361b22 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:01 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-30193e3c-2bf9-4fb6-b972-514dbd793dc4 req-e3c4ab36-efc9-442d-9a07-9a7d63361b22 service nova] Creating event network-vif-plugged:f9729e1e-db88-4e50-bc31-f2ad9a568084 for instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc on user Apr 13 15:10:01 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-30193e3c-2bf9-4fb6-b972-514dbd793dc4 req-e3c4ab36-efc9-442d-9a07-9a7d63361b22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052288 Apr 13 15:10:01 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 66/188] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:01 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-e1a13074-ac86-49c7-8ca9-fec9624fe2b2 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6747b03238c481d836caaf583f20a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fbef55fb3c43d69af48208d28c87f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:10:01 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-e1a13074-ac86-49c7-8ca9-fec9624fe2b2 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9" status: 200 len: 1673 microversion: 2.1 time: 0.209934 Apr 13 15:10:01 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 63/189] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:10:01 2023] GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9 => generated 1673 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:10:02 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:02 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:02 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:02 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:02 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:02 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:02 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:02 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] 10.0.0.210 "POST /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/os-interface" status: 200 len: 283 microversion: 2.49 time: 3.506565 Apr 13 15:10:02 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 61/190] 10.0.0.210 () {66 vars in 1414 bytes} [Thu Apr 13 15:09:58 2023] POST /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/os-interface => generated 283 bytes in 3513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:10:02 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7bf84ee-99d9-4818-9538-c1f3a2818935", "tag": "volume-tag"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:02 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:02 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:10:02 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] 10.0.0.210 "POST /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.325572 Apr 13 15:10:02 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 67/191] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 15:10:02 2023] POST /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:10:03 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "13c8ec19-b219-44c8-9c72-1a5a06e96d91"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:03 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:03 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc", "name": "network-vif-plugged", "status": "completed", "tag": "f9729e1e-db88-4e50-bc31-f2ad9a568084"}, {"server_uuid": "051e6c4e-3d10-4b43-9099-7abffd84d0d9", "name": "network-vif-unplugged", "status": "completed", "tag": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f"}, {"server_uuid": "051e6c4e-3d10-4b43-9099-7abffd84d0d9", "name": "network-vif-plugged", "status": "completed", "tag": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:03 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:03 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:03 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:03 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] Creating event network-vif-plugged:f9729e1e-db88-4e50-bc31-f2ad9a568084 for instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc on user Apr 13 15:10:03 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] Creating event network-vif-unplugged:a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f for instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 on user Apr 13 15:10:03 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] Creating event network-vif-plugged:a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f for instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 on user Apr 13 15:10:03 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.057847 Apr 13 15:10:03 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 62/192] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:03 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:04 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments/3c648678-ad4b-4ce5-b267-ebf3abef2c5d" status: 202 len: 0 microversion: 2.1 time: 0.400044 Apr 13 15:10:04 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 64/193] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 15:10:03 2023] PUT /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments/3c648678-ad4b-4ce5-b267-ebf3abef2c5d => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:10:04 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-3250c97b-7da6-4696-9d8d-777db32c48f2 req-85594f2c-8ed6-471d-94ac-805c544f4bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "051e6c4e-3d10-4b43-9099-7abffd84d0d9", "name": "network-vif-deleted", "tag": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3250c97b-7da6-4696-9d8d-777db32c48f2 req-85594f2c-8ed6-471d-94ac-805c544f4bef service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3250c97b-7da6-4696-9d8d-777db32c48f2 req-85594f2c-8ed6-471d-94ac-805c544f4bef service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3250c97b-7da6-4696-9d8d-777db32c48f2 req-85594f2c-8ed6-471d-94ac-805c544f4bef service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:04 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-3250c97b-7da6-4696-9d8d-777db32c48f2 req-85594f2c-8ed6-471d-94ac-805c544f4bef service nova] Creating event network-vif-deleted:a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f for instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 on user Apr 13 15:10:04 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-3250c97b-7da6-4696-9d8d-777db32c48f2 req-85594f2c-8ed6-471d-94ac-805c544f4bef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033792 Apr 13 15:10:04 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 68/194] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:09 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-b4b32e9f-83be-4ab3-950f-862c7495f877 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:09 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-b4b32e9f-83be-4ab3-950f-862c7495f877 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b4b32e9f-83be-4ab3-950f-862c7495f877 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b4b32e9f-83be-4ab3-950f-862c7495f877 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b4b32e9f-83be-4ab3-950f-862c7495f877 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b4b32e9f-83be-4ab3-950f-862c7495f877 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b4b32e9f-83be-4ab3-950f-862c7495f877 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b4b32e9f-83be-4ab3-950f-862c7495f877 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:10 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-b4b32e9f-83be-4ab3-950f-862c7495f877 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:10:10 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-b4b32e9f-83be-4ab3-950f-862c7495f877 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25f57234-8818-44d3-b476-d6cfba7b2810" status: 200 len: 1489 microversion: 2.1 time: 0.181287 Apr 13 15:10:10 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 63/195] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:10:09 2023] GET /compute/v2.1/servers/25f57234-8818-44d3-b476-d6cfba7b2810 => generated 1489 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:10:12 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:12 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:12 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:12 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:12 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:12 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:12 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:12 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:12 user devstack@n-api.service[61872]: DEBUG nova.objects.instance [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lazy-loading 'services' on Instance uuid 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc {{(pid=61872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:10:12 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/os-volume_attachments/e7bf84ee-99d9-4818-9538-c1f3a2818935" status: 202 len: 0 microversion: 2.49 time: 0.156060 Apr 13 15:10:12 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 65/196] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 15:10:12 2023] DELETE /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/os-volume_attachments/e7bf84ee-99d9-4818-9538-c1f3a2818935 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:10:14 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7fa5bc5b-10dc-44fc-9400-a70bf5db0de8 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:14 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-7fa5bc5b-10dc-44fc-9400-a70bf5db0de8 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:14 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:10:14 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=3,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:10:14 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7fa5bc5b-10dc-44fc-9400-a70bf5db0de8 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:14 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7fa5bc5b-10dc-44fc-9400-a70bf5db0de8 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:14 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7fa5bc5b-10dc-44fc-9400-a70bf5db0de8 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:14 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7fa5bc5b-10dc-44fc-9400-a70bf5db0de8 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:14 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7fa5bc5b-10dc-44fc-9400-a70bf5db0de8 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:14 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7fa5bc5b-10dc-44fc-9400-a70bf5db0de8 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:14 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7fa5bc5b-10dc-44fc-9400-a70bf5db0de8 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944/os-interface" status: 200 len: 1827 microversion: 2.32 time: 0.138954 Apr 13 15:10:14 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 69/197] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 15:10:14 2023] GET /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944/os-interface => generated 1827 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:10:16 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-788f42df-a846-4531-b3d4-09662c1b2e36 req-d6b2fa44-f752-4d28-a46d-8e17ebd482b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "tag": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:16 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=21 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:10:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-788f42df-a846-4531-b3d4-09662c1b2e36 req-d6b2fa44-f752-4d28-a46d-8e17ebd482b5 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-788f42df-a846-4531-b3d4-09662c1b2e36 req-d6b2fa44-f752-4d28-a46d-8e17ebd482b5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-788f42df-a846-4531-b3d4-09662c1b2e36 req-d6b2fa44-f752-4d28-a46d-8e17ebd482b5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:16 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=40,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:10:16 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-788f42df-a846-4531-b3d4-09662c1b2e36 req-d6b2fa44-f752-4d28-a46d-8e17ebd482b5 service nova] Creating event network-changed:6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:16 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-788f42df-a846-4531-b3d4-09662c1b2e36 req-d6b2fa44-f752-4d28-a46d-8e17ebd482b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054258 Apr 13 15:10:16 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 64/198] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:16 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-cd2062cb-7be2-4bfe-86ba-d1c20d4fb54e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:16 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-cd2062cb-7be2-4bfe-86ba-d1c20d4fb54e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:16 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=27 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:10:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cd2062cb-7be2-4bfe-86ba-d1c20d4fb54e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cd2062cb-7be2-4bfe-86ba-d1c20d4fb54e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cd2062cb-7be2-4bfe-86ba-d1c20d4fb54e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cd2062cb-7be2-4bfe-86ba-d1c20d4fb54e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cd2062cb-7be2-4bfe-86ba-d1c20d4fb54e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cd2062cb-7be2-4bfe-86ba-d1c20d4fb54e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:16 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=4,nova_cell1:INSERT=5 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:10:16 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:16 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:16 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/os-interface/f9729e1e-db88-4e50-bc31-f2ad9a568084" status: 202 len: 0 microversion: 2.49 time: 0.060051 Apr 13 15:10:16 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 70/199] 10.0.0.210 () {64 vars in 1507 bytes} [Thu Apr 13 15:10:16 2023] DELETE /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/os-interface/f9729e1e-db88-4e50-bc31-f2ad9a568084 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:10:16 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-20e50222-e324-495e-8bea-f9e0e0ea488b tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:16 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-20e50222-e324-495e-8bea-f9e0e0ea488b tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-20e50222-e324-495e-8bea-f9e0e0ea488b tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-20e50222-e324-495e-8bea-f9e0e0ea488b tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-20e50222-e324-495e-8bea-f9e0e0ea488b tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-20e50222-e324-495e-8bea-f9e0e0ea488b tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-20e50222-e324-495e-8bea-f9e0e0ea488b tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-20e50222-e324-495e-8bea-f9e0e0ea488b tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:16 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-cd2062cb-7be2-4bfe-86ba-d1c20d4fb54e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c18c8a515b457088a9901fbc86629f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd530eb6a4bf04f468299323520f56d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:10:16 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-cd2062cb-7be2-4bfe-86ba-d1c20d4fb54e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40c18c8a515b457088a9901fbc86629f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd530eb6a4bf04f468299323520f56d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:10:16 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-cd2062cb-7be2-4bfe-86ba-d1c20d4fb54e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40c18c8a515b457088a9901fbc86629f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd530eb6a4bf04f468299323520f56d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:10:16 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-cd2062cb-7be2-4bfe-86ba-d1c20d4fb54e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944" status: 200 len: 2821 microversion: 2.32 time: 0.413946 Apr 13 15:10:16 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 66/200] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:10:16 2023] GET /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944 => generated 2821 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 13 15:10:16 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-1ed86883-1bb4-40b9-98cd-f2cc9567a7ee tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:16 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-1ed86883-1bb4-40b9-98cd-f2cc9567a7ee tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1ed86883-1bb4-40b9-98cd-f2cc9567a7ee tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1ed86883-1bb4-40b9-98cd-f2cc9567a7ee tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1ed86883-1bb4-40b9-98cd-f2cc9567a7ee tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1ed86883-1bb4-40b9-98cd-f2cc9567a7ee tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1ed86883-1bb4-40b9-98cd-f2cc9567a7ee tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1ed86883-1bb4-40b9-98cd-f2cc9567a7ee tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:16 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-20e50222-e324-495e-8bea-f9e0e0ea488b tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/os-instance-actions/req-e35228e6-c525-4f75-b69e-6a5b71f9ae03" status: 200 len: 474 microversion: 2.49 time: 0.297064 Apr 13 15:10:16 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 65/201] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 15:10:16 2023] GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/os-instance-actions/req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 => generated 474 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:10:16 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-1ed86883-1bb4-40b9-98cd-f2cc9567a7ee tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944/os-interface" status: 200 len: 1827 microversion: 2.32 time: 0.228589 Apr 13 15:10:16 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 71/202] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 15:10:16 2023] GET /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944/os-interface => generated 1827 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:10:17 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-9dd458be-f172-4058-ac34-2e1f859e7aa4 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:17 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-9dd458be-f172-4058-ac34-2e1f859e7aa4 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dd458be-f172-4058-ac34-2e1f859e7aa4 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dd458be-f172-4058-ac34-2e1f859e7aa4 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dd458be-f172-4058-ac34-2e1f859e7aa4 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dd458be-f172-4058-ac34-2e1f859e7aa4 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dd458be-f172-4058-ac34-2e1f859e7aa4 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dd458be-f172-4058-ac34-2e1f859e7aa4 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:17 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-9dd458be-f172-4058-ac34-2e1f859e7aa4 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] HTTP exception thrown: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:17 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-9dd458be-f172-4058-ac34-2e1f859e7aa4 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Request method failure captured: Apr 13 15:10:17 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5 HTTP/1.1 Apr 13 15:10:17 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:10:17 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:10:17 user devstack@n-api.service[61872]: Connection: close Apr 13 15:10:17 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:10:17 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:10:17 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:10:17 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:10:17 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:10:17 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBqpi_WUBnLIWk_bJP-ht6bmHsBG_79QFrRoGbnZEvPoXQuToNsE07krkXQxJQLbSKdzM_gizwbEfHPOxYqC4Ax5R3nb2nWN4N9w3tmmd9_MeHfUD1uWOBY3RviggSM608GfViatF2foXPTfzQ21Go6zznM5H4_XXaUGWjY4cGlUE7Q Apr 13 15:10:17 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:10:17 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:10:17 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:10:17 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:10:17 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:10:17 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:10:17 user devstack@n-api.service[61872]: X-Project-Id: 62589c1782f2473ead9b4270af3982f6 Apr 13 15:10:17 user devstack@n-api.service[61872]: X-Project-Name: tempest-DeleteServersTestJSON-425509443 Apr 13 15:10:17 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:10:17 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:10:17 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/62589c1782f2473ead9b4270af3982f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62589c1782f2473ead9b4270af3982f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62589c1782f2473ead9b4270af3982f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:10:17 user devstack@n-api.service[61872]: X-Tenant: tempest-DeleteServersTestJSON-425509443 Apr 13 15:10:17 user devstack@n-api.service[61872]: X-Tenant-Id: 62589c1782f2473ead9b4270af3982f6 Apr 13 15:10:17 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-DeleteServersTestJSON-425509443 Apr 13 15:10:17 user devstack@n-api.service[61872]: X-User: tempest-DeleteServersTestJSON-425509443-project-member Apr 13 15:10:17 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:10:17 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:10:17 user devstack@n-api.service[61872]: X-User-Id: 2844897ef27d4395af0a8f069699ce4d Apr 13 15:10:17 user devstack@n-api.service[61872]: X-User-Name: tempest-DeleteServersTestJSON-425509443-project-member Apr 13 15:10:17 user devstack@n-api.service[61872]: method: > Apr 13 15:10:17 user devstack@n-api.service[61872]: exception: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:17 user devstack@n-api.service[61872]: action_args: {'id': '58a0788e-df82-4c1e-97dd-1d246048afc5'} Apr 13 15:10:17 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:10:17 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-9dd458be-f172-4058-ac34-2e1f859e7aa4 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Returning 404 to user: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:10:17 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-9dd458be-f172-4058-ac34-2e1f859e7aa4 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5" status: 404 len: 111 microversion: 2.1 time: 0.032303 Apr 13 15:10:17 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 67/203] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:10:17 2023] GET /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:10:17 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-dbaedebb-3b97-42e4-89cf-29d6c5f96675 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:17 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-dbaedebb-3b97-42e4-89cf-29d6c5f96675 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-dbaedebb-3b97-42e4-89cf-29d6c5f96675 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-dbaedebb-3b97-42e4-89cf-29d6c5f96675 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-dbaedebb-3b97-42e4-89cf-29d6c5f96675 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-dbaedebb-3b97-42e4-89cf-29d6c5f96675 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-dbaedebb-3b97-42e4-89cf-29d6c5f96675 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-dbaedebb-3b97-42e4-89cf-29d6c5f96675 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:17 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-dbaedebb-3b97-42e4-89cf-29d6c5f96675 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] HTTP exception thrown: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:17 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-dbaedebb-3b97-42e4-89cf-29d6c5f96675 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Request method failure captured: Apr 13 15:10:17 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5/os-volume_attachments HTTP/1.1 Apr 13 15:10:17 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:10:17 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:10:17 user devstack@n-api.service[61871]: Connection: close Apr 13 15:10:17 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:10:17 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:10:17 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:10:17 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:10:17 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:10:17 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBqpi_WUBnLIWk_bJP-ht6bmHsBG_79QFrRoGbnZEvPoXQuToNsE07krkXQxJQLbSKdzM_gizwbEfHPOxYqC4Ax5R3nb2nWN4N9w3tmmd9_MeHfUD1uWOBY3RviggSM608GfViatF2foXPTfzQ21Go6zznM5H4_XXaUGWjY4cGlUE7Q Apr 13 15:10:17 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:10:17 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:10:17 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:10:17 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:10:17 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:10:17 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:10:17 user devstack@n-api.service[61871]: X-Project-Id: 62589c1782f2473ead9b4270af3982f6 Apr 13 15:10:17 user devstack@n-api.service[61871]: X-Project-Name: tempest-DeleteServersTestJSON-425509443 Apr 13 15:10:17 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:10:17 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:10:17 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/62589c1782f2473ead9b4270af3982f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62589c1782f2473ead9b4270af3982f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62589c1782f2473ead9b4270af3982f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:10:17 user devstack@n-api.service[61871]: X-Tenant: tempest-DeleteServersTestJSON-425509443 Apr 13 15:10:17 user devstack@n-api.service[61871]: X-Tenant-Id: 62589c1782f2473ead9b4270af3982f6 Apr 13 15:10:17 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-DeleteServersTestJSON-425509443 Apr 13 15:10:17 user devstack@n-api.service[61871]: X-User: tempest-DeleteServersTestJSON-425509443-project-member Apr 13 15:10:17 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:10:17 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:10:17 user devstack@n-api.service[61871]: X-User-Id: 2844897ef27d4395af0a8f069699ce4d Apr 13 15:10:17 user devstack@n-api.service[61871]: X-User-Name: tempest-DeleteServersTestJSON-425509443-project-member Apr 13 15:10:17 user devstack@n-api.service[61871]: method: > Apr 13 15:10:17 user devstack@n-api.service[61871]: exception: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:17 user devstack@n-api.service[61871]: action_args: {'server_id': '58a0788e-df82-4c1e-97dd-1d246048afc5'} Apr 13 15:10:17 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:17 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-dbaedebb-3b97-42e4-89cf-29d6c5f96675 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Returning 404 to user: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:10:17 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-dbaedebb-3b97-42e4-89cf-29d6c5f96675 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.048402 Apr 13 15:10:17 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 66/204] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:10:17 2023] GET /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:10:17 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc", "name": "network-vif-deleted", "tag": "f9729e1e-db88-4e50-bc31-f2ad9a568084"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:17 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] Creating event network-vif-deleted:f9729e1e-db88-4e50-bc31-f2ad9a568084 for instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc on user Apr 13 15:10:17 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036290 Apr 13 15:10:17 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 72/205] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:18 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-73c1ea3c-64dd-4294-8539-8deb002868f6 req-14510a5f-77ae-48ce-84c6-dc50f6b4bc22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc", "name": "network-vif-unplugged", "status": "completed", "tag": "f9729e1e-db88-4e50-bc31-f2ad9a568084"}, {"server_uuid": "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc", "name": "network-vif-plugged", "status": "completed", "tag": "f9729e1e-db88-4e50-bc31-f2ad9a568084"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-73c1ea3c-64dd-4294-8539-8deb002868f6 req-14510a5f-77ae-48ce-84c6-dc50f6b4bc22 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-73c1ea3c-64dd-4294-8539-8deb002868f6 req-14510a5f-77ae-48ce-84c6-dc50f6b4bc22 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-73c1ea3c-64dd-4294-8539-8deb002868f6 req-14510a5f-77ae-48ce-84c6-dc50f6b4bc22 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:18 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:18 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:18 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-73c1ea3c-64dd-4294-8539-8deb002868f6 req-14510a5f-77ae-48ce-84c6-dc50f6b4bc22 service nova] Creating event network-vif-unplugged:f9729e1e-db88-4e50-bc31-f2ad9a568084 for instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc on user Apr 13 15:10:18 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-73c1ea3c-64dd-4294-8539-8deb002868f6 req-14510a5f-77ae-48ce-84c6-dc50f6b4bc22 service nova] Creating event network-vif-plugged:f9729e1e-db88-4e50-bc31-f2ad9a568084 for instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc on user Apr 13 15:10:18 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-73c1ea3c-64dd-4294-8539-8deb002868f6 req-14510a5f-77ae-48ce-84c6-dc50f6b4bc22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032779 Apr 13 15:10:18 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 68/206] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:18 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:18 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Going to try to terminate instance {{(pid=61871) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:10:18 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944" status: 204 len: 0 microversion: 2.32 time: 0.168505 Apr 13 15:10:18 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 67/207] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 15:10:18 2023] DELETE /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 15:10:18 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-d8ce93c7-ef69-461a-80d6-72089edc9640 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:18 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-d8ce93c7-ef69-461a-80d6-72089edc9640 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d8ce93c7-ef69-461a-80d6-72089edc9640 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d8ce93c7-ef69-461a-80d6-72089edc9640 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d8ce93c7-ef69-461a-80d6-72089edc9640 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d8ce93c7-ef69-461a-80d6-72089edc9640 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d8ce93c7-ef69-461a-80d6-72089edc9640 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d8ce93c7-ef69-461a-80d6-72089edc9640 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:18 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-ac1fbe99-c84e-4023-b60f-308bfaca5011 req-ce4250bc-d76d-43fe-9363-dbc41e371647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-unplugged", "status": "completed", "tag": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-ac1fbe99-c84e-4023-b60f-308bfaca5011 req-ce4250bc-d76d-43fe-9363-dbc41e371647 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-ac1fbe99-c84e-4023-b60f-308bfaca5011 req-ce4250bc-d76d-43fe-9363-dbc41e371647 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-ac1fbe99-c84e-4023-b60f-308bfaca5011 req-ce4250bc-d76d-43fe-9363-dbc41e371647 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:18 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-ac1fbe99-c84e-4023-b60f-308bfaca5011 req-ce4250bc-d76d-43fe-9363-dbc41e371647 service nova] Creating event network-vif-unplugged:0bbdcb7f-44fc-4144-9dcc-b82be1a036fd for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:18 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-ac1fbe99-c84e-4023-b60f-308bfaca5011 req-ce4250bc-d76d-43fe-9363-dbc41e371647 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036821 Apr 13 15:10:18 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 69/208] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:19 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-d8ce93c7-ef69-461a-80d6-72089edc9640 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c18c8a515b457088a9901fbc86629f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd530eb6a4bf04f468299323520f56d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:10:19 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-d8ce93c7-ef69-461a-80d6-72089edc9640 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40c18c8a515b457088a9901fbc86629f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd530eb6a4bf04f468299323520f56d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:10:19 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-d8ce93c7-ef69-461a-80d6-72089edc9640 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40c18c8a515b457088a9901fbc86629f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd530eb6a4bf04f468299323520f56d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:10:19 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-d8ce93c7-ef69-461a-80d6-72089edc9640 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944" status: 200 len: 2946 microversion: 2.32 time: 0.835962 Apr 13 15:10:19 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 73/209] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:10:18 2023] GET /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944 => generated 2946 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:10:20 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-unplugged", "status": "completed", "tag": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-unplugged", "status": "completed", "tag": "f81f8894-95c8-443a-92e6-0bbc31c8e87c"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "f81f8894-95c8-443a-92e6-0bbc31c8e87c"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-unplugged", "status": "completed", "tag": "d2e29dc8-81b4-4712-9be4-e97c7f116aed"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "d2e29dc8-81b4-4712-9be4-e97c7f116aed"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:20 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Creating event network-vif-unplugged:6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:20 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Creating event network-vif-plugged:6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:20 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Creating event network-vif-unplugged:f81f8894-95c8-443a-92e6-0bbc31c8e87c for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:20 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Creating event network-vif-plugged:f81f8894-95c8-443a-92e6-0bbc31c8e87c for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:20 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Creating event network-vif-unplugged:d2e29dc8-81b4-4712-9be4-e97c7f116aed for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:20 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Creating event network-vif-plugged:d2e29dc8-81b4-4712-9be4-e97c7f116aed for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:20 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1044 microversion: 2.1 time: 0.055140 Apr 13 15:10:20 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 68/210] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:20 2023] POST /compute/v2.1/os-server-external-events => generated 1044 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:10:20 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-899b9042-ce42-4350-8c69-24fa038b665d tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:20 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-899b9042-ce42-4350-8c69-24fa038b665d tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-899b9042-ce42-4350-8c69-24fa038b665d tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-899b9042-ce42-4350-8c69-24fa038b665d tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-899b9042-ce42-4350-8c69-24fa038b665d tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-899b9042-ce42-4350-8c69-24fa038b665d tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-899b9042-ce42-4350-8c69-24fa038b665d tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-899b9042-ce42-4350-8c69-24fa038b665d tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:20 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-899b9042-ce42-4350-8c69-24fa038b665d tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] 10.0.0.210 "GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054375 Apr 13 15:10:20 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 70/211] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:10:20 2023] GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:20 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-d3013787-a37f-4d2c-b581-854ef8c09557 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:20 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-d3013787-a37f-4d2c-b581-854ef8c09557 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d3013787-a37f-4d2c-b581-854ef8c09557 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d3013787-a37f-4d2c-b581-854ef8c09557 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d3013787-a37f-4d2c-b581-854ef8c09557 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d3013787-a37f-4d2c-b581-854ef8c09557 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d3013787-a37f-4d2c-b581-854ef8c09557 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d3013787-a37f-4d2c-b581-854ef8c09557 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:20 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-d3013787-a37f-4d2c-b581-854ef8c09557 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] 10.0.0.210 "GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080273 Apr 13 15:10:20 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 74/212] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:10:20 2023] GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:20 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "3c648678-ad4b-4ce5-b267-ebf3abef2c5d"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:20 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:20 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-unplugged", "status": "completed", "tag": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:20 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments/13c8ec19-b219-44c8-9c72-1a5a06e96d91" status: 202 len: 0 microversion: 2.1 time: 0.521876 Apr 13 15:10:20 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 69/213] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 15:10:20 2023] PUT /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments/13c8ec19-b219-44c8-9c72-1a5a06e96d91 => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:10:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:20 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] Creating event network-vif-plugged:0bbdcb7f-44fc-4144-9dcc-b82be1a036fd for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:20 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] Creating event network-vif-unplugged:a1f1b21e-12c3-4310-9ef0-791f4d09fc5f for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:20 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] Creating event network-vif-plugged:a1f1b21e-12c3-4310-9ef0-791f4d09fc5f for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:20 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.042923 Apr 13 15:10:20 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 71/214] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:20 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:21 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-fa1e7c6f-95d3-4898-ae3b-3d4356f161ef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:21 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-fa1e7c6f-95d3-4898-ae3b-3d4356f161ef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fa1e7c6f-95d3-4898-ae3b-3d4356f161ef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fa1e7c6f-95d3-4898-ae3b-3d4356f161ef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fa1e7c6f-95d3-4898-ae3b-3d4356f161ef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fa1e7c6f-95d3-4898-ae3b-3d4356f161ef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fa1e7c6f-95d3-4898-ae3b-3d4356f161ef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fa1e7c6f-95d3-4898-ae3b-3d4356f161ef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:21 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-fa1e7c6f-95d3-4898-ae3b-3d4356f161ef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] HTTP exception thrown: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:21 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-fa1e7c6f-95d3-4898-ae3b-3d4356f161ef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Request method failure captured: Apr 13 15:10:21 user devstack@n-api.service[61873]: request: DELETE /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5 HTTP/1.1 Apr 13 15:10:21 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:10:21 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:10:21 user devstack@n-api.service[61873]: Connection: close Apr 13 15:10:21 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:10:21 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:10:21 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:10:21 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:10:21 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:10:21 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBqpi_WUBnLIWk_bJP-ht6bmHsBG_79QFrRoGbnZEvPoXQuToNsE07krkXQxJQLbSKdzM_gizwbEfHPOxYqC4Ax5R3nb2nWN4N9w3tmmd9_MeHfUD1uWOBY3RviggSM608GfViatF2foXPTfzQ21Go6zznM5H4_XXaUGWjY4cGlUE7Q Apr 13 15:10:21 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:10:21 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:10:21 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:10:21 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:10:21 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:10:21 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:10:21 user devstack@n-api.service[61873]: X-Project-Id: 62589c1782f2473ead9b4270af3982f6 Apr 13 15:10:21 user devstack@n-api.service[61873]: X-Project-Name: tempest-DeleteServersTestJSON-425509443 Apr 13 15:10:21 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:10:21 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:10:21 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/62589c1782f2473ead9b4270af3982f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62589c1782f2473ead9b4270af3982f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62589c1782f2473ead9b4270af3982f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:10:21 user devstack@n-api.service[61873]: X-Tenant: tempest-DeleteServersTestJSON-425509443 Apr 13 15:10:21 user devstack@n-api.service[61873]: X-Tenant-Id: 62589c1782f2473ead9b4270af3982f6 Apr 13 15:10:21 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-DeleteServersTestJSON-425509443 Apr 13 15:10:21 user devstack@n-api.service[61873]: X-User: tempest-DeleteServersTestJSON-425509443-project-member Apr 13 15:10:21 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:10:21 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:10:21 user devstack@n-api.service[61873]: X-User-Id: 2844897ef27d4395af0a8f069699ce4d Apr 13 15:10:21 user devstack@n-api.service[61873]: X-User-Name: tempest-DeleteServersTestJSON-425509443-project-member Apr 13 15:10:21 user devstack@n-api.service[61873]: method: > Apr 13 15:10:21 user devstack@n-api.service[61873]: exception: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:21 user devstack@n-api.service[61873]: action_args: {'id': '58a0788e-df82-4c1e-97dd-1d246048afc5'} Apr 13 15:10:21 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:21 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:10:21 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-fa1e7c6f-95d3-4898-ae3b-3d4356f161ef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Returning 404 to user: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:10:21 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-fa1e7c6f-95d3-4898-ae3b-3d4356f161ef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5" status: 404 len: 111 microversion: 2.1 time: 0.033746 Apr 13 15:10:21 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 75/215] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:10:21 2023] DELETE /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:10:21 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c2176c86-3193-4ff3-a381-699a1c0f55d3 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:21 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-c2176c86-3193-4ff3-a381-699a1c0f55d3 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:21 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c2176c86-3193-4ff3-a381-699a1c0f55d3 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:21 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c2176c86-3193-4ff3-a381-699a1c0f55d3 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:21 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c2176c86-3193-4ff3-a381-699a1c0f55d3 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:21 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c2176c86-3193-4ff3-a381-699a1c0f55d3 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:21 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c2176c86-3193-4ff3-a381-699a1c0f55d3 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:21 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c2176c86-3193-4ff3-a381-699a1c0f55d3 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:21 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-c2176c86-3193-4ff3-a381-699a1c0f55d3 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] HTTP exception thrown: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:21 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c2176c86-3193-4ff3-a381-699a1c0f55d3 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Request method failure captured: Apr 13 15:10:21 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5 HTTP/1.1 Apr 13 15:10:21 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:10:21 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:10:21 user devstack@n-api.service[61871]: Connection: close Apr 13 15:10:21 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:10:21 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:10:21 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:10:21 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:10:21 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:10:21 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBqpi_WUBnLIWk_bJP-ht6bmHsBG_79QFrRoGbnZEvPoXQuToNsE07krkXQxJQLbSKdzM_gizwbEfHPOxYqC4Ax5R3nb2nWN4N9w3tmmd9_MeHfUD1uWOBY3RviggSM608GfViatF2foXPTfzQ21Go6zznM5H4_XXaUGWjY4cGlUE7Q Apr 13 15:10:21 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:10:21 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:10:21 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:10:21 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:10:21 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:10:21 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:10:21 user devstack@n-api.service[61871]: X-Project-Id: 62589c1782f2473ead9b4270af3982f6 Apr 13 15:10:21 user devstack@n-api.service[61871]: X-Project-Name: tempest-DeleteServersTestJSON-425509443 Apr 13 15:10:21 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:10:21 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:10:21 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/62589c1782f2473ead9b4270af3982f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62589c1782f2473ead9b4270af3982f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62589c1782f2473ead9b4270af3982f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:10:21 user devstack@n-api.service[61871]: X-Tenant: tempest-DeleteServersTestJSON-425509443 Apr 13 15:10:21 user devstack@n-api.service[61871]: X-Tenant-Id: 62589c1782f2473ead9b4270af3982f6 Apr 13 15:10:21 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-DeleteServersTestJSON-425509443 Apr 13 15:10:21 user devstack@n-api.service[61871]: X-User: tempest-DeleteServersTestJSON-425509443-project-member Apr 13 15:10:21 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:10:21 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:10:21 user devstack@n-api.service[61871]: X-User-Id: 2844897ef27d4395af0a8f069699ce4d Apr 13 15:10:21 user devstack@n-api.service[61871]: X-User-Name: tempest-DeleteServersTestJSON-425509443-project-member Apr 13 15:10:21 user devstack@n-api.service[61871]: method: > Apr 13 15:10:21 user devstack@n-api.service[61871]: exception: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:21 user devstack@n-api.service[61871]: action_args: {'id': '58a0788e-df82-4c1e-97dd-1d246048afc5'} Apr 13 15:10:21 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. Apr 13 15:10:21 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:21 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c2176c86-3193-4ff3-a381-699a1c0f55d3 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Returning 404 to user: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:10:21 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-c2176c86-3193-4ff3-a381-699a1c0f55d3 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5" status: 404 len: 111 microversion: 2.1 time: 0.034360 Apr 13 15:10:21 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 70/216] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:10:21 2023] GET /compute/v2.1/servers/58a0788e-df82-4c1e-97dd-1d246048afc5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 13 15:10:22 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-unplugged", "status": "completed", "tag": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-unplugged", "status": "completed", "tag": "c97ac499-c8fa-412e-9452-c6f80e69c879"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-plugged", "status": "completed", "tag": "c97ac499-c8fa-412e-9452-c6f80e69c879"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:22 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Creating event network-vif-unplugged:989ec3b8-1a00-47b5-9a07-71f33cfb6c69 for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:22 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Creating event network-vif-plugged:989ec3b8-1a00-47b5-9a07-71f33cfb6c69 for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:22 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Creating event network-vif-unplugged:c97ac499-c8fa-412e-9452-c6f80e69c879 for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:22 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Creating event network-vif-plugged:c97ac499-c8fa-412e-9452-c6f80e69c879 for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:22 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.051086 Apr 13 15:10:22 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 72/217] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:22 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:22 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-ef874951-c966-4261-be0e-bc4fdcb8fb13 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Calling method '.version_select at 0x7f3a8bb64b80>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:22 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-ef874951-c966-4261-be0e-bc4fdcb8fb13 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "GET /compute/v2.1/images/b09d887d-e4fc-48c4-a1b4-8c026c0de9fc" status: 200 len: 1723 microversion: 2.1 time: 0.058208 Apr 13 15:10:22 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 76/218] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 15:10:22 2023] GET /compute/v2.1/images/b09d887d-e4fc-48c4-a1b4-8c026c0de9fc => generated 1723 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:10:22 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-4e20cffc-2ceb-43fe-b375-bb6465a0c691 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Calling method '.version_select at 0x7f3a8fe71360>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:22 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-4e20cffc-2ceb-43fe-b375-bb6465a0c691 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "GET /compute/v2.1/images/b09d887d-e4fc-48c4-a1b4-8c026c0de9fc" status: 200 len: 1723 microversion: 2.1 time: 0.049825 Apr 13 15:10:22 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 71/219] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 15:10:22 2023] GET /compute/v2.1/images/b09d887d-e4fc-48c4-a1b4-8c026c0de9fc => generated 1723 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:10:22 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-c0f07cb5-aa3b-4380-a86a-27fec7a5f9df tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:22 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-c0f07cb5-aa3b-4380-a86a-27fec7a5f9df tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c0f07cb5-aa3b-4380-a86a-27fec7a5f9df tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c0f07cb5-aa3b-4380-a86a-27fec7a5f9df tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c0f07cb5-aa3b-4380-a86a-27fec7a5f9df tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c0f07cb5-aa3b-4380-a86a-27fec7a5f9df tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c0f07cb5-aa3b-4380-a86a-27fec7a5f9df tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c0f07cb5-aa3b-4380-a86a-27fec7a5f9df tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:22 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-c0f07cb5-aa3b-4380-a86a-27fec7a5f9df tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30a69b780664742aed58bd9a578e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5acb52755c74d118d012e38feed7237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:10:22 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-c0f07cb5-aa3b-4380-a86a-27fec7a5f9df tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818" status: 200 len: 1672 microversion: 2.1 time: 0.219563 Apr 13 15:10:22 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 73/220] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:10:22 2023] GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818 => generated 1672 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:10:23 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-56a72738-41d0-42d5-b70f-80cbc5fd9723 req-947aae01-3dad-477e-8f09-e9f2482ad40d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-deleted", "tag": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-56a72738-41d0-42d5-b70f-80cbc5fd9723 req-947aae01-3dad-477e-8f09-e9f2482ad40d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-56a72738-41d0-42d5-b70f-80cbc5fd9723 req-947aae01-3dad-477e-8f09-e9f2482ad40d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-56a72738-41d0-42d5-b70f-80cbc5fd9723 req-947aae01-3dad-477e-8f09-e9f2482ad40d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:23 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-56a72738-41d0-42d5-b70f-80cbc5fd9723 req-947aae01-3dad-477e-8f09-e9f2482ad40d service nova] Creating event network-vif-deleted:0bbdcb7f-44fc-4144-9dcc-b82be1a036fd for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:23 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-56a72738-41d0-42d5-b70f-80cbc5fd9723 req-947aae01-3dad-477e-8f09-e9f2482ad40d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042920 Apr 13 15:10:23 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 77/221] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:25 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-06b7e877-6126-4784-b839-4da06b43cedb req-c9a5cf4c-b78e-497e-bd91-b0a16f5197aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-deleted", "tag": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-deleted", "tag": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-deleted", "tag": "c97ac499-c8fa-412e-9452-c6f80e69c879"}, {"server_uuid": "e84c85a8-b97d-44ac-b0b3-f898860f5944", "name": "network-vif-deleted", "tag": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-06b7e877-6126-4784-b839-4da06b43cedb req-c9a5cf4c-b78e-497e-bd91-b0a16f5197aa service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-06b7e877-6126-4784-b839-4da06b43cedb req-c9a5cf4c-b78e-497e-bd91-b0a16f5197aa service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-06b7e877-6126-4784-b839-4da06b43cedb req-c9a5cf4c-b78e-497e-bd91-b0a16f5197aa service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:26 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-06b7e877-6126-4784-b839-4da06b43cedb req-c9a5cf4c-b78e-497e-bd91-b0a16f5197aa service nova] Creating event network-vif-deleted:6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:26 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-06b7e877-6126-4784-b839-4da06b43cedb req-c9a5cf4c-b78e-497e-bd91-b0a16f5197aa service nova] Creating event network-vif-deleted:a1f1b21e-12c3-4310-9ef0-791f4d09fc5f for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:26 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-06b7e877-6126-4784-b839-4da06b43cedb req-c9a5cf4c-b78e-497e-bd91-b0a16f5197aa service nova] Creating event network-vif-deleted:c97ac499-c8fa-412e-9452-c6f80e69c879 for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:26 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-06b7e877-6126-4784-b839-4da06b43cedb req-c9a5cf4c-b78e-497e-bd91-b0a16f5197aa service nova] Creating event network-vif-deleted:989ec3b8-1a00-47b5-9a07-71f33cfb6c69 for instance e84c85a8-b97d-44ac-b0b3-f898860f5944 on user Apr 13 15:10:26 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-06b7e877-6126-4784-b839-4da06b43cedb req-c9a5cf4c-b78e-497e-bd91-b0a16f5197aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.039634 Apr 13 15:10:26 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 72/222] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:25 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:32 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-370949425", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "928c080b-0ead-4f65-85b3-2c98a7549dbb"}]}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:32 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=15 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:10:32 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=27 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:10:32 user devstack@n-api.service[61872]: DEBUG nova.network.neutron [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] validate_networks() for [('928c080b-0ead-4f65-85b3-2c98a7549dbb', None, None, None, None, None)] {{(pid=61872) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:10:33 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor limits 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:10:33 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image limits 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:10:33 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor pref 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:10:33 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image pref 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:10:33 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:10:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:33 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Getting quotas for project 240b28f42732478ba732994b2c9e3fbe. Resources: {'cores', 'instances', 'ram'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:10:33 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Getting quotas for user 75bf6e19993f4c2e90fd52c4d6212622 and project 240b28f42732478ba732994b2c9e3fbe. Resources: {'cores', 'instances', 'ram'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:10:33 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Going to run 1 instances... {{(pid=61872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:10:33 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:10:33 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.549354 Apr 13 15:10:33 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 74/223] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 15:10:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 15:10:33 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f835f0f2-214d-43cc-a4fd-41399a4ca6f9 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:33 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-f835f0f2-214d-43cc-a4fd-41399a4ca6f9 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:33 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-f835f0f2-214d-43cc-a4fd-41399a4ca6f9 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:10:33 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-f835f0f2-214d-43cc-a4fd-41399a4ca6f9 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:10:33 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-f835f0f2-214d-43cc-a4fd-41399a4ca6f9 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:10:33 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-f835f0f2-214d-43cc-a4fd-41399a4ca6f9 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473" status: 200 len: 1394 microversion: 2.87 time: 0.081281 Apr 13 15:10:33 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 78/224] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:10:33 2023] GET /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473 => generated 1394 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:10:34 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-bf011323-a536-49b2-b5f1-1b3eab2d30d6 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:34 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-bf011323-a536-49b2-b5f1-1b3eab2d30d6 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-bf011323-a536-49b2-b5f1-1b3eab2d30d6 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-bf011323-a536-49b2-b5f1-1b3eab2d30d6 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-bf011323-a536-49b2-b5f1-1b3eab2d30d6 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-bf011323-a536-49b2-b5f1-1b3eab2d30d6 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-bf011323-a536-49b2-b5f1-1b3eab2d30d6 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-bf011323-a536-49b2-b5f1-1b3eab2d30d6 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:34 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-bf011323-a536-49b2-b5f1-1b3eab2d30d6 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] HTTP exception thrown: Instance 63f69337-7ae4-4125-a560-f6cbcb2298d4 could not be found. Apr 13 15:10:34 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-bf011323-a536-49b2-b5f1-1b3eab2d30d6 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Request method failure captured: Apr 13 15:10:34 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/63f69337-7ae4-4125-a560-f6cbcb2298d4 HTTP/1.1 Apr 13 15:10:34 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:10:34 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:10:34 user devstack@n-api.service[61871]: Connection: close Apr 13 15:10:34 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:10:34 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:10:34 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:10:34 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:10:34 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:10:34 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBrFEpUjIIYQb8dqEmcAkhsb5Ng4h0bcFgOhw9tuO5kqmLpiuWIhoSxtgV7tBbKPTSSPH-Faia54fzI-bT74vT-rJE78P8kAqSWqH0ySkUPNPS1BdjEughNMEgACgP4Lf9z1ArekuxccFWhiXAFM8ATE8lxUm6Adsswch81HOgebMQ4 Apr 13 15:10:34 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:10:34 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:10:34 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:10:34 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:10:34 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:10:34 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:10:34 user devstack@n-api.service[61871]: X-Project-Id: 51c1b992977a479883e445330b3d0d97 Apr 13 15:10:34 user devstack@n-api.service[61871]: X-Project-Name: tempest-VolumesNegativeTest-2050412996 Apr 13 15:10:34 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:10:34 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:10:34 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/51c1b992977a479883e445330b3d0d97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51c1b992977a479883e445330b3d0d97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51c1b992977a479883e445330b3d0d97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:10:34 user devstack@n-api.service[61871]: X-Tenant: tempest-VolumesNegativeTest-2050412996 Apr 13 15:10:34 user devstack@n-api.service[61871]: X-Tenant-Id: 51c1b992977a479883e445330b3d0d97 Apr 13 15:10:34 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-VolumesNegativeTest-2050412996 Apr 13 15:10:34 user devstack@n-api.service[61871]: X-User: tempest-VolumesNegativeTest-2050412996-project-member Apr 13 15:10:34 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:10:34 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:10:34 user devstack@n-api.service[61871]: X-User-Id: e8adc8b289e548a5ac16b6356753d6dc Apr 13 15:10:34 user devstack@n-api.service[61871]: X-User-Name: tempest-VolumesNegativeTest-2050412996-project-member Apr 13 15:10:34 user devstack@n-api.service[61871]: method: > Apr 13 15:10:34 user devstack@n-api.service[61871]: exception: Instance 63f69337-7ae4-4125-a560-f6cbcb2298d4 could not be found. Apr 13 15:10:34 user devstack@n-api.service[61871]: action_args: {'id': '63f69337-7ae4-4125-a560-f6cbcb2298d4'} Apr 13 15:10:34 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63f69337-7ae4-4125-a560-f6cbcb2298d4 could not be found. Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63f69337-7ae4-4125-a560-f6cbcb2298d4 could not be found. Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63f69337-7ae4-4125-a560-f6cbcb2298d4 could not be found. Apr 13 15:10:34 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:34 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-bf011323-a536-49b2-b5f1-1b3eab2d30d6 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Returning 404 to user: Instance 63f69337-7ae4-4125-a560-f6cbcb2298d4 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:10:34 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-bf011323-a536-49b2-b5f1-1b3eab2d30d6 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] 10.0.0.210 "GET /compute/v2.1/servers/63f69337-7ae4-4125-a560-f6cbcb2298d4" status: 404 len: 111 microversion: 2.1 time: 0.032151 Apr 13 15:10:34 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 73/225] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:10:34 2023] GET /compute/v2.1/servers/63f69337-7ae4-4125-a560-f6cbcb2298d4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:10:35 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-0d9d6977-9d94-4905-b8a5-6e856b4b3263 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:35 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-0d9d6977-9d94-4905-b8a5-6e856b4b3263 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0d9d6977-9d94-4905-b8a5-6e856b4b3263 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0d9d6977-9d94-4905-b8a5-6e856b4b3263 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0d9d6977-9d94-4905-b8a5-6e856b4b3263 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0d9d6977-9d94-4905-b8a5-6e856b4b3263 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0d9d6977-9d94-4905-b8a5-6e856b4b3263 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0d9d6977-9d94-4905-b8a5-6e856b4b3263 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:35 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-0d9d6977-9d94-4905-b8a5-6e856b4b3263 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] 10.0.0.210 "GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054979 Apr 13 15:10:35 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 75/226] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:10:35 2023] GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:35 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-67823e46-ec0b-4052-9572-91b45055a6c8 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:35 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-67823e46-ec0b-4052-9572-91b45055a6c8 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:35 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:10:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-67823e46-ec0b-4052-9572-91b45055a6c8 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-67823e46-ec0b-4052-9572-91b45055a6c8 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-67823e46-ec0b-4052-9572-91b45055a6c8 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-67823e46-ec0b-4052-9572-91b45055a6c8 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-67823e46-ec0b-4052-9572-91b45055a6c8 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-67823e46-ec0b-4052-9572-91b45055a6c8 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:35 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-67823e46-ec0b-4052-9572-91b45055a6c8 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] 10.0.0.210 "GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057531 Apr 13 15:10:35 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 79/227] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:10:35 2023] GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:35 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:35 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:35 user devstack@n-api.service[61871]: DEBUG nova.objects.instance [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lazy-loading 'services' on Instance uuid 193136fc-e6c3-4e70-b7ab-01ced440c6bd {{(pid=61871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:10:35 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments/3c648678-ad4b-4ce5-b267-ebf3abef2c5d" status: 202 len: 0 microversion: 2.1 time: 0.291820 Apr 13 15:10:35 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 74/228] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:10:35 2023] DELETE /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments/3c648678-ad4b-4ce5-b267-ebf3abef2c5d => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:10:35 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-1d79b9ac-152c-400e-bc4a-8adff9ec08d3 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:35 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-1d79b9ac-152c-400e-bc4a-8adff9ec08d3 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-1d79b9ac-152c-400e-bc4a-8adff9ec08d3 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-1d79b9ac-152c-400e-bc4a-8adff9ec08d3 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-1d79b9ac-152c-400e-bc4a-8adff9ec08d3 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-1d79b9ac-152c-400e-bc4a-8adff9ec08d3 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-1d79b9ac-152c-400e-bc4a-8adff9ec08d3 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-1d79b9ac-152c-400e-bc4a-8adff9ec08d3 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:35 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-1d79b9ac-152c-400e-bc4a-8adff9ec08d3 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] 10.0.0.210 "GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069360 Apr 13 15:10:35 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 76/229] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:10:35 2023] GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:36 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-756ffcbc-4f2d-441f-b35f-a7b31ed990b3 req-1b210e87-a35c-4006-a6d1-1c1afe6630ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a0a9548-9e57-4007-bafb-d418a4433473", "tag": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-756ffcbc-4f2d-441f-b35f-a7b31ed990b3 req-1b210e87-a35c-4006-a6d1-1c1afe6630ef service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-756ffcbc-4f2d-441f-b35f-a7b31ed990b3 req-1b210e87-a35c-4006-a6d1-1c1afe6630ef service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-756ffcbc-4f2d-441f-b35f-a7b31ed990b3 req-1b210e87-a35c-4006-a6d1-1c1afe6630ef service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:36 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-756ffcbc-4f2d-441f-b35f-a7b31ed990b3 req-1b210e87-a35c-4006-a6d1-1c1afe6630ef service nova] Creating event network-changed:0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance 0a0a9548-9e57-4007-bafb-d418a4433473 on user Apr 13 15:10:36 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-756ffcbc-4f2d-441f-b35f-a7b31ed990b3 req-1b210e87-a35c-4006-a6d1-1c1afe6630ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034743 Apr 13 15:10:36 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 80/230] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:43 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-68d69b3f-452e-4160-b0e6-30bdba80bd59 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:43 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-68d69b3f-452e-4160-b0e6-30bdba80bd59 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-68d69b3f-452e-4160-b0e6-30bdba80bd59 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-68d69b3f-452e-4160-b0e6-30bdba80bd59 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-68d69b3f-452e-4160-b0e6-30bdba80bd59 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-68d69b3f-452e-4160-b0e6-30bdba80bd59 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-68d69b3f-452e-4160-b0e6-30bdba80bd59 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-68d69b3f-452e-4160-b0e6-30bdba80bd59 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:43 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-68d69b3f-452e-4160-b0e6-30bdba80bd59 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc0cce3df7540078438186f46ca4621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7227559570b54e92be19d25938523b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:10:43 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-68d69b3f-452e-4160-b0e6-30bdba80bd59 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211" status: 200 len: 1433 microversion: 2.1 time: 0.191692 Apr 13 15:10:43 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 75/231] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:10:43 2023] GET /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211 => generated 1433 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:10:45 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-3ed4a6ee-c269-41ce-8d40-2d78ea103bc0 req-35513afa-c155-45cb-b8fb-54df5bdbfcda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179b6945-589d-402c-a89e-6b8d68725211", "tag": "b6a42460-29f0-496d-a7ba-d7ae2259f317"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:45 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:10:45 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:10:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3ed4a6ee-c269-41ce-8d40-2d78ea103bc0 req-35513afa-c155-45cb-b8fb-54df5bdbfcda service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3ed4a6ee-c269-41ce-8d40-2d78ea103bc0 req-35513afa-c155-45cb-b8fb-54df5bdbfcda service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3ed4a6ee-c269-41ce-8d40-2d78ea103bc0 req-35513afa-c155-45cb-b8fb-54df5bdbfcda service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:45 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-3ed4a6ee-c269-41ce-8d40-2d78ea103bc0 req-35513afa-c155-45cb-b8fb-54df5bdbfcda service nova] Creating event network-changed:b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance 179b6945-589d-402c-a89e-6b8d68725211 on user Apr 13 15:10:45 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-3ed4a6ee-c269-41ce-8d40-2d78ea103bc0 req-35513afa-c155-45cb-b8fb-54df5bdbfcda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037095 Apr 13 15:10:45 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 77/232] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:45 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:10:45 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:45 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:45 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=27 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:10:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:45 user devstack@n-api.service[61873]: DEBUG nova.objects.instance [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lazy-loading 'flavor' on Instance uuid 179b6945-589d-402c-a89e-6b8d68725211 {{(pid=61873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:10:46 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] 10.0.0.210 "POST /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211/action" status: 202 len: 0 microversion: 2.1 time: 0.187791 Apr 13 15:10:46 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 81/233] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:10:45 2023] POST /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:10:46 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c73db479-f129-4649-9b7a-f7f5560710f6 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:46 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-c73db479-f129-4649-9b7a-f7f5560710f6 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c73db479-f129-4649-9b7a-f7f5560710f6 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c73db479-f129-4649-9b7a-f7f5560710f6 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c73db479-f129-4649-9b7a-f7f5560710f6 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c73db479-f129-4649-9b7a-f7f5560710f6 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c73db479-f129-4649-9b7a-f7f5560710f6 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c73db479-f129-4649-9b7a-f7f5560710f6 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:46 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-c73db479-f129-4649-9b7a-f7f5560710f6 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc0cce3df7540078438186f46ca4621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7227559570b54e92be19d25938523b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:10:46 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-c73db479-f129-4649-9b7a-f7f5560710f6 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211" status: 200 len: 1439 microversion: 2.1 time: 0.214037 Apr 13 15:10:46 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 76/234] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:10:46 2023] GET /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211 => generated 1439 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:10:46 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-ac9e9546-a8e8-4979-bf98-122093ff830e req-192e8dd7-6722-4070-8331-23b3f82debf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179b6945-589d-402c-a89e-6b8d68725211", "name": "network-vif-unplugged", "status": "completed", "tag": "b6a42460-29f0-496d-a7ba-d7ae2259f317"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-ac9e9546-a8e8-4979-bf98-122093ff830e req-192e8dd7-6722-4070-8331-23b3f82debf4 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-ac9e9546-a8e8-4979-bf98-122093ff830e req-192e8dd7-6722-4070-8331-23b3f82debf4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-ac9e9546-a8e8-4979-bf98-122093ff830e req-192e8dd7-6722-4070-8331-23b3f82debf4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:46 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-ac9e9546-a8e8-4979-bf98-122093ff830e req-192e8dd7-6722-4070-8331-23b3f82debf4 service nova] Creating event network-vif-unplugged:b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance 179b6945-589d-402c-a89e-6b8d68725211 on user Apr 13 15:10:46 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-ac9e9546-a8e8-4979-bf98-122093ff830e req-192e8dd7-6722-4070-8331-23b3f82debf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045495 Apr 13 15:10:46 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 78/235] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:48 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-1fce4a8d-efeb-43d9-9683-c163b12534f1 req-f14586e6-9502-4eb9-a531-ba6ac35f1212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0a9548-9e57-4007-bafb-d418a4433473", "name": "network-vif-plugged", "status": "completed", "tag": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:48 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-1fce4a8d-efeb-43d9-9683-c163b12534f1 req-f14586e6-9502-4eb9-a531-ba6ac35f1212 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:48 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-1fce4a8d-efeb-43d9-9683-c163b12534f1 req-f14586e6-9502-4eb9-a531-ba6ac35f1212 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:48 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-1fce4a8d-efeb-43d9-9683-c163b12534f1 req-f14586e6-9502-4eb9-a531-ba6ac35f1212 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:48 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-1fce4a8d-efeb-43d9-9683-c163b12534f1 req-f14586e6-9502-4eb9-a531-ba6ac35f1212 service nova] Creating event network-vif-plugged:0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance 0a0a9548-9e57-4007-bafb-d418a4433473 on user Apr 13 15:10:48 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-1fce4a8d-efeb-43d9-9683-c163b12534f1 req-f14586e6-9502-4eb9-a531-ba6ac35f1212 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033429 Apr 13 15:10:48 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 82/236] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:48 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-efe32f40-3db3-42a8-a2f8-536fb98138ca req-df34ce21-464b-4a22-86fc-90d598fb5ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179b6945-589d-402c-a89e-6b8d68725211", "name": "network-vif-plugged", "status": "completed", "tag": "b6a42460-29f0-496d-a7ba-d7ae2259f317"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:48 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:10:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-efe32f40-3db3-42a8-a2f8-536fb98138ca req-df34ce21-464b-4a22-86fc-90d598fb5ad4 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-efe32f40-3db3-42a8-a2f8-536fb98138ca req-df34ce21-464b-4a22-86fc-90d598fb5ad4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-efe32f40-3db3-42a8-a2f8-536fb98138ca req-df34ce21-464b-4a22-86fc-90d598fb5ad4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:48 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:10:48 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-efe32f40-3db3-42a8-a2f8-536fb98138ca req-df34ce21-464b-4a22-86fc-90d598fb5ad4 service nova] Creating event network-vif-plugged:b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance 179b6945-589d-402c-a89e-6b8d68725211 on user Apr 13 15:10:48 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-efe32f40-3db3-42a8-a2f8-536fb98138ca req-df34ce21-464b-4a22-86fc-90d598fb5ad4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042132 Apr 13 15:10:48 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 77/237] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:48 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-193004e0-26bd-4396-8dfb-4378ebad7462 req-aa016a49-1074-40c3-9fdf-b1512e821e50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179b6945-589d-402c-a89e-6b8d68725211", "tag": "b6a42460-29f0-496d-a7ba-d7ae2259f317"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-193004e0-26bd-4396-8dfb-4378ebad7462 req-aa016a49-1074-40c3-9fdf-b1512e821e50 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-193004e0-26bd-4396-8dfb-4378ebad7462 req-aa016a49-1074-40c3-9fdf-b1512e821e50 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-193004e0-26bd-4396-8dfb-4378ebad7462 req-aa016a49-1074-40c3-9fdf-b1512e821e50 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:48 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-193004e0-26bd-4396-8dfb-4378ebad7462 req-aa016a49-1074-40c3-9fdf-b1512e821e50 service nova] Creating event network-changed:b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance 179b6945-589d-402c-a89e-6b8d68725211 on user Apr 13 15:10:48 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-193004e0-26bd-4396-8dfb-4378ebad7462 req-aa016a49-1074-40c3-9fdf-b1512e821e50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034943 Apr 13 15:10:48 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 79/238] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:48 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1114961218", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "networks": [{"uuid": "e03ac49b-a391-40fb-930c-49644a153431"}]}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:48 user devstack@n-api.service[61873]: DEBUG nova.network.neutron [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] validate_networks() for [('e03ac49b-a391-40fb-930c-49644a153431', None, None, None, None, None)] {{(pid=61873) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:10:49 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Flavor limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:10:49 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Image limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:10:49 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Flavor pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:10:49 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Image pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:10:49 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:10:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:49 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Getting quotas for project 2c0cae04ab4b4157a7ef786d165789a6. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:10:49 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Getting quotas for user 3bdc942f33ca46c08bb143ed2efeb458 and project 2c0cae04ab4b4157a7ef786d165789a6. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:10:49 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Going to run 1 instances... {{(pid=61873) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:10:49 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:10:50 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.174769 Apr 13 15:10:50 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 83/239] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:10:48 2023] POST /compute/v2.1/servers => generated 378 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:10:50 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-076e2500-3c39-4ae6-90f7-72d2de1cec62 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:50 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-076e2500-3c39-4ae6-90f7-72d2de1cec62 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:50 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-076e2500-3c39-4ae6-90f7-72d2de1cec62 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc942f33ca46c08bb143ed2efeb458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0cae04ab4b4157a7ef786d165789a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:10:50 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-076e2500-3c39-4ae6-90f7-72d2de1cec62 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c9a3524-caeb-4333-ae2b-1080115026fd" status: 200 len: 1208 microversion: 2.1 time: 0.132670 Apr 13 15:10:50 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 78/240] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:10:50 2023] GET /compute/v2.1/servers/1c9a3524-caeb-4333-ae2b-1080115026fd => generated 1208 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:10:50 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-bbca55ad-1614-4bd4-9bc7-8096c3ab439e req-3c5ca4ef-0e1e-49a1-b3cc-be07992bda34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0a9548-9e57-4007-bafb-d418a4433473", "name": "network-vif-plugged", "status": "completed", "tag": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-bbca55ad-1614-4bd4-9bc7-8096c3ab439e req-3c5ca4ef-0e1e-49a1-b3cc-be07992bda34 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-bbca55ad-1614-4bd4-9bc7-8096c3ab439e req-3c5ca4ef-0e1e-49a1-b3cc-be07992bda34 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-bbca55ad-1614-4bd4-9bc7-8096c3ab439e req-3c5ca4ef-0e1e-49a1-b3cc-be07992bda34 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:50 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-bbca55ad-1614-4bd4-9bc7-8096c3ab439e req-3c5ca4ef-0e1e-49a1-b3cc-be07992bda34 service nova] Creating event network-vif-plugged:0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance 0a0a9548-9e57-4007-bafb-d418a4433473 on user Apr 13 15:10:50 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-bbca55ad-1614-4bd4-9bc7-8096c3ab439e req-3c5ca4ef-0e1e-49a1-b3cc-be07992bda34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055570 Apr 13 15:10:50 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 80/241] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:51 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-ce7a84b1-4ae8-4e9e-8ed1-78d01c9d86ae tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:51 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-ce7a84b1-4ae8-4e9e-8ed1-78d01c9d86ae tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ce7a84b1-4ae8-4e9e-8ed1-78d01c9d86ae tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ce7a84b1-4ae8-4e9e-8ed1-78d01c9d86ae tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ce7a84b1-4ae8-4e9e-8ed1-78d01c9d86ae tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ce7a84b1-4ae8-4e9e-8ed1-78d01c9d86ae tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ce7a84b1-4ae8-4e9e-8ed1-78d01c9d86ae tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ce7a84b1-4ae8-4e9e-8ed1-78d01c9d86ae tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:51 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-ce7a84b1-4ae8-4e9e-8ed1-78d01c9d86ae tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044169 Apr 13 15:10:51 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 84/242] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:10:51 2023] GET /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:10:51 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-548228514", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "networks": [{"uuid": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e"}]}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:51 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] validate_networks() for [('ef80378f-a9cf-4f0f-80cd-90ff2384f88e', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:10:52 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-440a9671-cd73-42dc-89e7-45d59502a877 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:52 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-440a9671-cd73-42dc-89e7-45d59502a877 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-440a9671-cd73-42dc-89e7-45d59502a877 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-440a9671-cd73-42dc-89e7-45d59502a877 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-440a9671-cd73-42dc-89e7-45d59502a877 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-440a9671-cd73-42dc-89e7-45d59502a877 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-440a9671-cd73-42dc-89e7-45d59502a877 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-440a9671-cd73-42dc-89e7-45d59502a877 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:52 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-440a9671-cd73-42dc-89e7-45d59502a877 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] HTTP exception thrown: Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 could not be found. Apr 13 15:10:52 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-440a9671-cd73-42dc-89e7-45d59502a877 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Request method failure captured: Apr 13 15:10:52 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9 HTTP/1.1 Apr 13 15:10:52 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:10:52 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:10:52 user devstack@n-api.service[61872]: Connection: close Apr 13 15:10:52 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:10:52 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:10:52 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:10:52 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:10:52 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:10:52 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBqmDeqlWvKJI8Fbs-_BDAl-6sjv149ECJLqPXspuG17L4sL1PzuUmHgORSMfy7nR0dLt23yursDHvn01P3iYpXy5qvPObH3gK55c_Bmmz-BXRH9mlNE2ha9j2NVRnnLEph3QL4Nf2_2Tf9LIZ7BDitQin0dWtWp3gJObumGTl2SXow Apr 13 15:10:52 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:10:52 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:10:52 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:10:52 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:10:52 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:10:52 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:10:52 user devstack@n-api.service[61872]: X-Project-Id: 89fbef55fb3c43d69af48208d28c87f0 Apr 13 15:10:52 user devstack@n-api.service[61872]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-264698011 Apr 13 15:10:52 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:10:52 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:10:52 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/89fbef55fb3c43d69af48208d28c87f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/89fbef55fb3c43d69af48208d28c87f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/89fbef55fb3c43d69af48208d28c87f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:10:52 user devstack@n-api.service[61872]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-264698011 Apr 13 15:10:52 user devstack@n-api.service[61872]: X-Tenant-Id: 89fbef55fb3c43d69af48208d28c87f0 Apr 13 15:10:52 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-264698011 Apr 13 15:10:52 user devstack@n-api.service[61872]: X-User: tempest-AttachSCSIVolumeTestJSON-264698011-project-member Apr 13 15:10:52 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:10:52 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:10:52 user devstack@n-api.service[61872]: X-User-Id: f6747b03238c481d836caaf583f20a16 Apr 13 15:10:52 user devstack@n-api.service[61872]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-264698011-project-member Apr 13 15:10:52 user devstack@n-api.service[61872]: method: > Apr 13 15:10:52 user devstack@n-api.service[61872]: exception: Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 could not be found. Apr 13 15:10:52 user devstack@n-api.service[61872]: action_args: {'id': '051e6c4e-3d10-4b43-9099-7abffd84d0d9'} Apr 13 15:10:52 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 could not be found. Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 could not be found. Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 could not be found. Apr 13 15:10:52 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:10:52 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-440a9671-cd73-42dc-89e7-45d59502a877 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Returning 404 to user: Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:10:52 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-440a9671-cd73-42dc-89e7-45d59502a877 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9" status: 404 len: 111 microversion: 2.1 time: 0.030099 Apr 13 15:10:52 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 81/243] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:10:52 2023] GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:10:52 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c8afc1a3-14d0-4e0f-b331-7dc775b85e31 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Calling method '.version_select at 0x7f3a8bc808b0>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:52 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-c8afc1a3-14d0-4e0f-b331-7dc775b85e31 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-815100895" status: 202 len: 0 microversion: 2.1 time: 0.105778 Apr 13 15:10:52 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 85/244] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 15:10:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-815100895 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:10:52 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:10:52 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:10:52 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:10:52 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:10:52 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:10:52 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:52 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:52 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:52 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:52 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:52 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:52 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Getting quotas for project 8f7b81912360422a8413f8760b0cf7e1. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:10:52 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Getting quotas for user 54b07929cf2c404ab10ce944437e9e97 and project 8f7b81912360422a8413f8760b0cf7e1. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:10:52 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-61ddab6c-0087-4735-9709-93ae434ebdc9 req-c69fa3e9-d798-46ff-b763-7bf801bd433d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c9a3524-caeb-4333-ae2b-1080115026fd", "tag": "575668b5-eb5b-4275-962a-db577c3931a0"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:52 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:10:52 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:10:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-61ddab6c-0087-4735-9709-93ae434ebdc9 req-c69fa3e9-d798-46ff-b763-7bf801bd433d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-61ddab6c-0087-4735-9709-93ae434ebdc9 req-c69fa3e9-d798-46ff-b763-7bf801bd433d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-61ddab6c-0087-4735-9709-93ae434ebdc9 req-c69fa3e9-d798-46ff-b763-7bf801bd433d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:52 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-61ddab6c-0087-4735-9709-93ae434ebdc9 req-c69fa3e9-d798-46ff-b763-7bf801bd433d service nova] Creating event network-changed:575668b5-eb5b-4275-962a-db577c3931a0 for instance 1c9a3524-caeb-4333-ae2b-1080115026fd on user Apr 13 15:10:52 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-61ddab6c-0087-4735-9709-93ae434ebdc9 req-c69fa3e9-d798-46ff-b763-7bf801bd433d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033116 Apr 13 15:10:52 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 82/245] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:52 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.166710 Apr 13 15:10:52 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 79/246] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:10:51 2023] POST /compute/v2.1/servers => generated 378 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:10:52 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-ff5f00a3-4a98-40b1-bae0-70fa2a84fcca tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:52 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-ff5f00a3-4a98-40b1-bae0-70fa2a84fcca tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:52 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-ff5f00a3-4a98-40b1-bae0-70fa2a84fcca tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b07929cf2c404ab10ce944437e9e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7b81912360422a8413f8760b0cf7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:10:52 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-ff5f00a3-4a98-40b1-bae0-70fa2a84fcca tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfc41492-c482-4a9f-8a5b-9d7520dea39a" status: 200 len: 1211 microversion: 2.1 time: 0.076437 Apr 13 15:10:52 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 86/247] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:10:52 2023] GET /compute/v2.1/servers/bfc41492-c482-4a9f-8a5b-9d7520dea39a => generated 1211 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:10:55 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-bdd1b4de-1873-4087-8c87-8196f90cb26b req-3753e342-be87-47f4-b44b-9fb22f897d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c9a3524-caeb-4333-ae2b-1080115026fd", "name": "network-vif-plugged", "status": "completed", "tag": "575668b5-eb5b-4275-962a-db577c3931a0"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-bdd1b4de-1873-4087-8c87-8196f90cb26b req-3753e342-be87-47f4-b44b-9fb22f897d27 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-bdd1b4de-1873-4087-8c87-8196f90cb26b req-3753e342-be87-47f4-b44b-9fb22f897d27 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-bdd1b4de-1873-4087-8c87-8196f90cb26b req-3753e342-be87-47f4-b44b-9fb22f897d27 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:55 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-bdd1b4de-1873-4087-8c87-8196f90cb26b req-3753e342-be87-47f4-b44b-9fb22f897d27 service nova] Creating event network-vif-plugged:575668b5-eb5b-4275-962a-db577c3931a0 for instance 1c9a3524-caeb-4333-ae2b-1080115026fd on user Apr 13 15:10:55 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-bdd1b4de-1873-4087-8c87-8196f90cb26b req-3753e342-be87-47f4-b44b-9fb22f897d27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047092 Apr 13 15:10:55 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 83/248] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:55 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-5fb3f47a-ed22-43c0-8936-c96911c3d515 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:55 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-5fb3f47a-ed22-43c0-8936-c96911c3d515 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5fb3f47a-ed22-43c0-8936-c96911c3d515 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5fb3f47a-ed22-43c0-8936-c96911c3d515 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5fb3f47a-ed22-43c0-8936-c96911c3d515 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5fb3f47a-ed22-43c0-8936-c96911c3d515 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5fb3f47a-ed22-43c0-8936-c96911c3d515 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5fb3f47a-ed22-43c0-8936-c96911c3d515 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:55 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-5fb3f47a-ed22-43c0-8936-c96911c3d515 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] HTTP exception thrown: Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 could not be found. Apr 13 15:10:55 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-5fb3f47a-ed22-43c0-8936-c96911c3d515 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Request method failure captured: Apr 13 15:10:55 user devstack@n-api.service[61871]: request: DELETE /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9 HTTP/1.1 Apr 13 15:10:55 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:10:55 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:10:55 user devstack@n-api.service[61871]: Connection: close Apr 13 15:10:55 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:10:55 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:10:55 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:10:55 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:10:55 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:10:55 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBqmDeqlWvKJI8Fbs-_BDAl-6sjv149ECJLqPXspuG17L4sL1PzuUmHgORSMfy7nR0dLt23yursDHvn01P3iYpXy5qvPObH3gK55c_Bmmz-BXRH9mlNE2ha9j2NVRnnLEph3QL4Nf2_2Tf9LIZ7BDitQin0dWtWp3gJObumGTl2SXow Apr 13 15:10:55 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:10:55 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:10:55 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:10:55 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:10:55 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:10:55 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:10:55 user devstack@n-api.service[61871]: X-Project-Id: 89fbef55fb3c43d69af48208d28c87f0 Apr 13 15:10:55 user devstack@n-api.service[61871]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-264698011 Apr 13 15:10:55 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:10:55 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:10:55 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/89fbef55fb3c43d69af48208d28c87f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/89fbef55fb3c43d69af48208d28c87f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/89fbef55fb3c43d69af48208d28c87f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:10:55 user devstack@n-api.service[61871]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-264698011 Apr 13 15:10:55 user devstack@n-api.service[61871]: X-Tenant-Id: 89fbef55fb3c43d69af48208d28c87f0 Apr 13 15:10:55 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-264698011 Apr 13 15:10:55 user devstack@n-api.service[61871]: X-User: tempest-AttachSCSIVolumeTestJSON-264698011-project-member Apr 13 15:10:55 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:10:55 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:10:55 user devstack@n-api.service[61871]: X-User-Id: f6747b03238c481d836caaf583f20a16 Apr 13 15:10:55 user devstack@n-api.service[61871]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-264698011-project-member Apr 13 15:10:55 user devstack@n-api.service[61871]: method: > Apr 13 15:10:55 user devstack@n-api.service[61871]: exception: Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 could not be found. Apr 13 15:10:55 user devstack@n-api.service[61871]: action_args: {'id': '051e6c4e-3d10-4b43-9099-7abffd84d0d9'} Apr 13 15:10:55 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 could not be found. Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 could not be found. Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 could not be found. Apr 13 15:10:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:10:55 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-5fb3f47a-ed22-43c0-8936-c96911c3d515 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Returning 404 to user: Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:10:55 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-5fb3f47a-ed22-43c0-8936-c96911c3d515 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9" status: 404 len: 111 microversion: 2.1 time: 0.037760 Apr 13 15:10:55 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 80/249] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:10:55 2023] DELETE /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:10:55 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-dce45f8c-7092-459a-86dc-2ba8818eadad tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:10:55 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-dce45f8c-7092-459a-86dc-2ba8818eadad tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:10:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-dce45f8c-7092-459a-86dc-2ba8818eadad tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-dce45f8c-7092-459a-86dc-2ba8818eadad tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-dce45f8c-7092-459a-86dc-2ba8818eadad tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-dce45f8c-7092-459a-86dc-2ba8818eadad tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-dce45f8c-7092-459a-86dc-2ba8818eadad tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-dce45f8c-7092-459a-86dc-2ba8818eadad tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:55 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-dce45f8c-7092-459a-86dc-2ba8818eadad tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] HTTP exception thrown: Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 could not be found. Apr 13 15:10:55 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-dce45f8c-7092-459a-86dc-2ba8818eadad tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Request method failure captured: Apr 13 15:10:55 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9 HTTP/1.1 Apr 13 15:10:55 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:10:55 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:10:55 user devstack@n-api.service[61873]: Connection: close Apr 13 15:10:55 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:10:55 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:10:55 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:10:55 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:10:55 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:10:55 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBqmDeqlWvKJI8Fbs-_BDAl-6sjv149ECJLqPXspuG17L4sL1PzuUmHgORSMfy7nR0dLt23yursDHvn01P3iYpXy5qvPObH3gK55c_Bmmz-BXRH9mlNE2ha9j2NVRnnLEph3QL4Nf2_2Tf9LIZ7BDitQin0dWtWp3gJObumGTl2SXow Apr 13 15:10:55 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:10:55 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:10:55 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:10:55 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:10:55 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:10:55 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:10:55 user devstack@n-api.service[61873]: X-Project-Id: 89fbef55fb3c43d69af48208d28c87f0 Apr 13 15:10:55 user devstack@n-api.service[61873]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-264698011 Apr 13 15:10:55 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:10:55 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:10:55 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/89fbef55fb3c43d69af48208d28c87f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/89fbef55fb3c43d69af48208d28c87f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/89fbef55fb3c43d69af48208d28c87f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:10:55 user devstack@n-api.service[61873]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-264698011 Apr 13 15:10:55 user devstack@n-api.service[61873]: X-Tenant-Id: 89fbef55fb3c43d69af48208d28c87f0 Apr 13 15:10:55 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-264698011 Apr 13 15:10:55 user devstack@n-api.service[61873]: X-User: tempest-AttachSCSIVolumeTestJSON-264698011-project-member Apr 13 15:10:55 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:10:55 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:10:55 user devstack@n-api.service[61873]: X-User-Id: f6747b03238c481d836caaf583f20a16 Apr 13 15:10:55 user devstack@n-api.service[61873]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-264698011-project-member Apr 13 15:10:55 user devstack@n-api.service[61873]: method: > Apr 13 15:10:55 user devstack@n-api.service[61873]: exception: Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 could not be found. Apr 13 15:10:55 user devstack@n-api.service[61873]: action_args: {'id': '051e6c4e-3d10-4b43-9099-7abffd84d0d9'} Apr 13 15:10:55 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 could not be found. Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 could not be found. Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 could not be found. Apr 13 15:10:55 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:10:55 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-dce45f8c-7092-459a-86dc-2ba8818eadad tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Returning 404 to user: Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:10:55 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-dce45f8c-7092-459a-86dc-2ba8818eadad tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] 10.0.0.210 "GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9" status: 404 len: 111 microversion: 2.1 time: 0.034778 Apr 13 15:10:55 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 87/250] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:10:55 2023] GET /compute/v2.1/servers/051e6c4e-3d10-4b43-9099-7abffd84d0d9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:10:55 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-20efd936-f614-4c67-810a-4738041c4a92 req-57fa0b71-b080-4be2-a529-f1dcfda7cbf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfc41492-c482-4a9f-8a5b-9d7520dea39a", "tag": "4251e566-faf6-4d5a-a5be-048443db64db"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-20efd936-f614-4c67-810a-4738041c4a92 req-57fa0b71-b080-4be2-a529-f1dcfda7cbf3 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-20efd936-f614-4c67-810a-4738041c4a92 req-57fa0b71-b080-4be2-a529-f1dcfda7cbf3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-20efd936-f614-4c67-810a-4738041c4a92 req-57fa0b71-b080-4be2-a529-f1dcfda7cbf3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:55 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-20efd936-f614-4c67-810a-4738041c4a92 req-57fa0b71-b080-4be2-a529-f1dcfda7cbf3 service nova] Creating event network-changed:4251e566-faf6-4d5a-a5be-048443db64db for instance bfc41492-c482-4a9f-8a5b-9d7520dea39a on user Apr 13 15:10:55 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-20efd936-f614-4c67-810a-4738041c4a92 req-57fa0b71-b080-4be2-a529-f1dcfda7cbf3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033003 Apr 13 15:10:55 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 84/251] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:10:57 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-31f22b7d-3a7c-4d6a-bca0-7a1ad5a0bc18 req-bc3e0795-06be-47af-997a-c752069d6bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c9a3524-caeb-4333-ae2b-1080115026fd", "name": "network-vif-plugged", "status": "completed", "tag": "575668b5-eb5b-4275-962a-db577c3931a0"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-31f22b7d-3a7c-4d6a-bca0-7a1ad5a0bc18 req-bc3e0795-06be-47af-997a-c752069d6bad service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-31f22b7d-3a7c-4d6a-bca0-7a1ad5a0bc18 req-bc3e0795-06be-47af-997a-c752069d6bad service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-31f22b7d-3a7c-4d6a-bca0-7a1ad5a0bc18 req-bc3e0795-06be-47af-997a-c752069d6bad service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:57 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-31f22b7d-3a7c-4d6a-bca0-7a1ad5a0bc18 req-bc3e0795-06be-47af-997a-c752069d6bad service nova] Creating event network-vif-plugged:575668b5-eb5b-4275-962a-db577c3931a0 for instance 1c9a3524-caeb-4333-ae2b-1080115026fd on user Apr 13 15:10:57 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-31f22b7d-3a7c-4d6a-bca0-7a1ad5a0bc18 req-bc3e0795-06be-47af-997a-c752069d6bad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057593 Apr 13 15:10:57 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 81/252] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:57 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-b8a4ab26-34f7-46ed-bcad-1d1b49efa938 req-4b54170a-55d2-4e96-a212-a21b1ed94ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc41492-c482-4a9f-8a5b-9d7520dea39a", "name": "network-vif-plugged", "status": "completed", "tag": "4251e566-faf6-4d5a-a5be-048443db64db"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b8a4ab26-34f7-46ed-bcad-1d1b49efa938 req-4b54170a-55d2-4e96-a212-a21b1ed94ba7 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b8a4ab26-34f7-46ed-bcad-1d1b49efa938 req-4b54170a-55d2-4e96-a212-a21b1ed94ba7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b8a4ab26-34f7-46ed-bcad-1d1b49efa938 req-4b54170a-55d2-4e96-a212-a21b1ed94ba7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:10:57 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-b8a4ab26-34f7-46ed-bcad-1d1b49efa938 req-4b54170a-55d2-4e96-a212-a21b1ed94ba7 service nova] Creating event network-vif-plugged:4251e566-faf6-4d5a-a5be-048443db64db for instance bfc41492-c482-4a9f-8a5b-9d7520dea39a on user Apr 13 15:10:57 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-b8a4ab26-34f7-46ed-bcad-1d1b49efa938 req-4b54170a-55d2-4e96-a212-a21b1ed94ba7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029779 Apr 13 15:10:57 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 88/253] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:10:59 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-d9efc0b4-2d86-4f93-b7e5-3c37c91da8e9 req-a847f671-9935-46b0-9da9-1fdc3e3a7d62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc41492-c482-4a9f-8a5b-9d7520dea39a", "name": "network-vif-plugged", "status": "completed", "tag": "4251e566-faf6-4d5a-a5be-048443db64db"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:10:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-d9efc0b4-2d86-4f93-b7e5-3c37c91da8e9 req-a847f671-9935-46b0-9da9-1fdc3e3a7d62 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:10:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-d9efc0b4-2d86-4f93-b7e5-3c37c91da8e9 req-a847f671-9935-46b0-9da9-1fdc3e3a7d62 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:10:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-d9efc0b4-2d86-4f93-b7e5-3c37c91da8e9 req-a847f671-9935-46b0-9da9-1fdc3e3a7d62 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:00 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-d9efc0b4-2d86-4f93-b7e5-3c37c91da8e9 req-a847f671-9935-46b0-9da9-1fdc3e3a7d62 service nova] Creating event network-vif-plugged:4251e566-faf6-4d5a-a5be-048443db64db for instance bfc41492-c482-4a9f-8a5b-9d7520dea39a on user Apr 13 15:11:00 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-d9efc0b4-2d86-4f93-b7e5-3c37c91da8e9 req-a847f671-9935-46b0-9da9-1fdc3e3a7d62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036971 Apr 13 15:11:00 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 85/254] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:10:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:11:06 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:06 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=8 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-a98ab636-afe3-49d3-9f5e-64478ccad08a tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:06 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-a98ab636-afe3-49d3-9f5e-64478ccad08a tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a98ab636-afe3-49d3-9f5e-64478ccad08a tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a98ab636-afe3-49d3-9f5e-64478ccad08a tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a98ab636-afe3-49d3-9f5e-64478ccad08a tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a98ab636-afe3-49d3-9f5e-64478ccad08a tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a98ab636-afe3-49d3-9f5e-64478ccad08a tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a98ab636-afe3-49d3-9f5e-64478ccad08a tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:06 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-a98ab636-afe3-49d3-9f5e-64478ccad08a tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/os-instance-actions/req-e35228e6-c525-4f75-b69e-6a5b71f9ae03" status: 200 len: 503 microversion: 2.49 time: 0.056266 Apr 13 15:11:06 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 82/255] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 15:11:06 2023] GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/os-instance-actions/req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 => generated 503 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=8 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f744b293-9b9b-422f-82a3-f5a276a78610 tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-f744b293-9b9b-422f-82a3-f5a276a78610 tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f744b293-9b9b-422f-82a3-f5a276a78610 tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f744b293-9b9b-422f-82a3-f5a276a78610 tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f744b293-9b9b-422f-82a3-f5a276a78610 tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f744b293-9b9b-422f-82a3-f5a276a78610 tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f744b293-9b9b-422f-82a3-f5a276a78610 tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f744b293-9b9b-422f-82a3-f5a276a78610 tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:06 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-f744b293-9b9b-422f-82a3-f5a276a78610 tempest-TaggedAttachmentsTest-352004124 tempest-TaggedAttachmentsTest-352004124-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/os-instance-actions/req-e35228e6-c525-4f75-b69e-6a5b71f9ae03" status: 200 len: 503 microversion: 2.49 time: 0.110406 Apr 13 15:11:06 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 89/256] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 15:11:06 2023] GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/os-instance-actions/req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 => generated 503 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:11:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-c4a5e8f7-94cc-427f-9c5f-723ff9d28484 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Action: 'create', calling method: .version_select at 0x7f3a8fa1d7e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1980539872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2KhvSB5J03IhhEg5JA/tj1cG2BDSPmL+5jFj0Unl3L4uq4s1XIJI5/ab1Vik7nfl+6oJRIw2tTNA1sr/iUc9YAfC+JNpGyE3k2x1hnrhzYW5YHXhMGc7caYhQEORU1KQ=="}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:06 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:06 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-c4a5e8f7-94cc-427f-9c5f-723ff9d28484 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Getting quotas for project 738150b0ec0c4ce887397f161c7e8c21. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:11:06 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-c4a5e8f7-94cc-427f-9c5f-723ff9d28484 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Getting quotas for user c2322f71af2a478291bfb9d34046394c and project 738150b0ec0c4ce887397f161c7e8c21. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:11:06 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-c4a5e8f7-94cc-427f-9c5f-723ff9d28484 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050343 Apr 13 15:11:06 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 86/257] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 15:11:06 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:11:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-99ae6745-6d71-4430-ab87-aeeb406959cf tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:06 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-99ae6745-6d71-4430-ab87-aeeb406959cf tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-99ae6745-6d71-4430-ab87-aeeb406959cf tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-99ae6745-6d71-4430-ab87-aeeb406959cf tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-99ae6745-6d71-4430-ab87-aeeb406959cf tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-99ae6745-6d71-4430-ab87-aeeb406959cf tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-99ae6745-6d71-4430-ab87-aeeb406959cf tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-99ae6745-6d71-4430-ab87-aeeb406959cf tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:06 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-99ae6745-6d71-4430-ab87-aeeb406959cf tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.047884 Apr 13 15:11:06 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 83/258] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 15:11:06 2023] GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:06 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Going to try to terminate instance {{(pid=61873) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:11:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-377290664", "imageRef": "be4d330c-57e5-4ce4-afe8-c2b8be481516", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1980539872", "networks": [{"uuid": "31820944-67f5-43ce-b68d-522060649204"}]}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:07 user devstack@n-api.service[61872]: DEBUG nova.network.neutron [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] validate_networks() for [('31820944-67f5-43ce-b68d-522060649204', None, None, None, None, None)] {{(pid=61872) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:11:07 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" status: 204 len: 0 microversion: 2.49 time: 0.116816 Apr 13 15:11:07 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 90/259] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 15:11:06 2023] DELETE /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 15:11:07 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-02677013-79ff-4ccf-bc42-77e053e66876 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:07 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-02677013-79ff-4ccf-bc42-77e053e66876 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-02677013-79ff-4ccf-bc42-77e053e66876 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-02677013-79ff-4ccf-bc42-77e053e66876 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-02677013-79ff-4ccf-bc42-77e053e66876 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-02677013-79ff-4ccf-bc42-77e053e66876 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-02677013-79ff-4ccf-bc42-77e053e66876 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-02677013-79ff-4ccf-bc42-77e053e66876 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:07 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-7108c170-6f32-409b-a7ac-fc3d69013614 req-cc23f884-c497-4c8e-b595-284446b1404f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc", "name": "network-vif-unplugged", "status": "completed", "tag": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-7108c170-6f32-409b-a7ac-fc3d69013614 req-cc23f884-c497-4c8e-b595-284446b1404f service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-7108c170-6f32-409b-a7ac-fc3d69013614 req-cc23f884-c497-4c8e-b595-284446b1404f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-7108c170-6f32-409b-a7ac-fc3d69013614 req-cc23f884-c497-4c8e-b595-284446b1404f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:07 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-7108c170-6f32-409b-a7ac-fc3d69013614 req-cc23f884-c497-4c8e-b595-284446b1404f service nova] Creating event network-vif-unplugged:ce8e302f-1f0b-46e0-82ef-9809a6ad81db for instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc on user Apr 13 15:11:07 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-7108c170-6f32-409b-a7ac-fc3d69013614 req-cc23f884-c497-4c8e-b595-284446b1404f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053590 Apr 13 15:11:07 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 91/260] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:11:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:11:07 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-02677013-79ff-4ccf-bc42-77e053e66876 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b59f4d6492a4821a621b18766bf58fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23bf27d7ed4f0abf2fdc60ae1edb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:11:07 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-02677013-79ff-4ccf-bc42-77e053e66876 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b59f4d6492a4821a621b18766bf58fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23bf27d7ed4f0abf2fdc60ae1edb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:11:07 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-02677013-79ff-4ccf-bc42-77e053e66876 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b59f4d6492a4821a621b18766bf58fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23bf27d7ed4f0abf2fdc60ae1edb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:11:07 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-02677013-79ff-4ccf-bc42-77e053e66876 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" status: 200 len: 1754 microversion: 2.49 time: 0.341583 Apr 13 15:11:07 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 84/261] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:11:07 2023] GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc => generated 1754 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:11:07 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Flavor limits 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:11:07 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Image limits 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:11:07 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Flavor pref 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:11:07 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Image pref 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:11:07 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:11:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:07 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=33 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:07 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Getting quotas for project 738150b0ec0c4ce887397f161c7e8c21. Resources: {'cores', 'instances', 'ram'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:11:07 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Getting quotas for user c2322f71af2a478291bfb9d34046394c and project 738150b0ec0c4ce887397f161c7e8c21. Resources: {'cores', 'instances', 'ram'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:11:07 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Going to run 1 instances... {{(pid=61872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:11:07 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='be4d330c-57e5-4ce4-afe8-c2b8be481516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:11:07 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.678160 Apr 13 15:11:07 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 87/262] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:11:06 2023] POST /compute/v2.1/servers => generated 378 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:11:07 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-89577022-fe1e-423d-934a-c8d01f3cd7e4 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:07 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-89577022-fe1e-423d-934a-c8d01f3cd7e4 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:07 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-89577022-fe1e-423d-934a-c8d01f3cd7e4 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:11:07 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-89577022-fe1e-423d-934a-c8d01f3cd7e4 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" status: 200 len: 1252 microversion: 2.1 time: 0.101454 Apr 13 15:11:07 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 92/263] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:11:07 2023] GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff => generated 1252 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:11:09 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-ed112440-e3db-4d35-9832-ad866e8cd81e req-f95bde00-f769-4761-9bcb-fe2dc16ea1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc", "name": "network-vif-deleted", "tag": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ed112440-e3db-4d35-9832-ad866e8cd81e req-f95bde00-f769-4761-9bcb-fe2dc16ea1e0 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ed112440-e3db-4d35-9832-ad866e8cd81e req-f95bde00-f769-4761-9bcb-fe2dc16ea1e0 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ed112440-e3db-4d35-9832-ad866e8cd81e req-f95bde00-f769-4761-9bcb-fe2dc16ea1e0 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:09 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-ed112440-e3db-4d35-9832-ad866e8cd81e req-f95bde00-f769-4761-9bcb-fe2dc16ea1e0 service nova] Creating event network-vif-deleted:ce8e302f-1f0b-46e0-82ef-9809a6ad81db for instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc on user Apr 13 15:11:09 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-ed112440-e3db-4d35-9832-ad866e8cd81e req-f95bde00-f769-4761-9bcb-fe2dc16ea1e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042023 Apr 13 15:11:09 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 85/264] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:11:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:11:09 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-fcd7532d-f0f3-453d-abbb-8359a22aa1c7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:09 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-fcd7532d-f0f3-453d-abbb-8359a22aa1c7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-fcd7532d-f0f3-453d-abbb-8359a22aa1c7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-fcd7532d-f0f3-453d-abbb-8359a22aa1c7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-fcd7532d-f0f3-453d-abbb-8359a22aa1c7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-fcd7532d-f0f3-453d-abbb-8359a22aa1c7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-fcd7532d-f0f3-453d-abbb-8359a22aa1c7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-fcd7532d-f0f3-453d-abbb-8359a22aa1c7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:09 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-fcd7532d-f0f3-453d-abbb-8359a22aa1c7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] HTTP exception thrown: Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 could not be found. Apr 13 15:11:09 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-fcd7532d-f0f3-453d-abbb-8359a22aa1c7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Request method failure captured: Apr 13 15:11:09 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944 HTTP/1.1 Apr 13 15:11:09 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:11:09 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:11:09 user devstack@n-api.service[61872]: Connection: close Apr 13 15:11:09 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:11:09 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:11:09 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:11:09 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:11:09 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:11:09 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBqpQ9IZLxeXr6vTE0vMTDJZ2UqZEPzykufIr3qfIzTrYfcfReZI88jA_oeZP26qARPntxMYCOPsISLESBpGPCoDkrsQwmmY5-n_7qXjsi0_WFYOWW3aBfS7o85IQqPLyWroEu_BLWlEoNmID-meVm0qn6B2KqzZPTah3FdxCK1umpg Apr 13 15:11:09 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:11:09 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:11:09 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:11:09 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:11:09 user devstack@n-api.service[61872]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 15:11:09 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:11:09 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:11:09 user devstack@n-api.service[61872]: X-Project-Id: d530eb6a4bf04f468299323520f56d1d Apr 13 15:11:09 user devstack@n-api.service[61872]: X-Project-Name: tempest-TaggedBootDevicesTest-1120084057 Apr 13 15:11:09 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:11:09 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:11:09 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d530eb6a4bf04f468299323520f56d1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d530eb6a4bf04f468299323520f56d1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d530eb6a4bf04f468299323520f56d1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:11:09 user devstack@n-api.service[61872]: X-Tenant: tempest-TaggedBootDevicesTest-1120084057 Apr 13 15:11:09 user devstack@n-api.service[61872]: X-Tenant-Id: d530eb6a4bf04f468299323520f56d1d Apr 13 15:11:09 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1120084057 Apr 13 15:11:09 user devstack@n-api.service[61872]: X-User: tempest-TaggedBootDevicesTest-1120084057-project-member Apr 13 15:11:09 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:11:09 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:11:09 user devstack@n-api.service[61872]: X-User-Id: 40c18c8a515b457088a9901fbc86629f Apr 13 15:11:09 user devstack@n-api.service[61872]: X-User-Name: tempest-TaggedBootDevicesTest-1120084057-project-member Apr 13 15:11:09 user devstack@n-api.service[61872]: method: > Apr 13 15:11:09 user devstack@n-api.service[61872]: exception: Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 could not be found. Apr 13 15:11:09 user devstack@n-api.service[61872]: action_args: {'id': 'e84c85a8-b97d-44ac-b0b3-f898860f5944'} Apr 13 15:11:09 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 could not be found. Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 could not be found. Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 could not be found. Apr 13 15:11:09 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:11:09 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-fcd7532d-f0f3-453d-abbb-8359a22aa1c7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Returning 404 to user: Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:11:09 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-fcd7532d-f0f3-453d-abbb-8359a22aa1c7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944" status: 404 len: 111 microversion: 2.32 time: 0.033460 Apr 13 15:11:09 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 88/265] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:11:09 2023] GET /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:11:09 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-5eac0368-4e96-44b3-937e-9c158aeb8eba tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Calling method '.version_select at 0x7f3a8bed9990>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:09 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-5eac0368-4e96-44b3-937e-9c158aeb8eba tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-522600936" status: 204 len: 0 microversion: 2.32 time: 0.024745 Apr 13 15:11:09 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 93/266] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 13 15:11:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-522600936 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 15:11:09 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-494a9dc3-a151-4fac-9d26-690f154663e0 req-35b52776-132a-42de-aaf4-23c7e27e004c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc", "name": "network-vif-plugged", "status": "completed", "tag": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-494a9dc3-a151-4fac-9d26-690f154663e0 req-35b52776-132a-42de-aaf4-23c7e27e004c service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-494a9dc3-a151-4fac-9d26-690f154663e0 req-35b52776-132a-42de-aaf4-23c7e27e004c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-494a9dc3-a151-4fac-9d26-690f154663e0 req-35b52776-132a-42de-aaf4-23c7e27e004c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:09 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-494a9dc3-a151-4fac-9d26-690f154663e0 req-35b52776-132a-42de-aaf4-23c7e27e004c service nova] Creating event network-vif-plugged:ce8e302f-1f0b-46e0-82ef-9809a6ad81db for instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc on user Apr 13 15:11:09 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-494a9dc3-a151-4fac-9d26-690f154663e0 req-35b52776-132a-42de-aaf4-23c7e27e004c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042645 Apr 13 15:11:09 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 86/267] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:11:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:11:10 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d07fc752-986d-4a92-9ed1-14f2660e2e97 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:10 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-d07fc752-986d-4a92-9ed1-14f2660e2e97 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d07fc752-986d-4a92-9ed1-14f2660e2e97 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d07fc752-986d-4a92-9ed1-14f2660e2e97 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d07fc752-986d-4a92-9ed1-14f2660e2e97 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d07fc752-986d-4a92-9ed1-14f2660e2e97 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d07fc752-986d-4a92-9ed1-14f2660e2e97 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d07fc752-986d-4a92-9ed1-14f2660e2e97 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:10 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-d07fc752-986d-4a92-9ed1-14f2660e2e97 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:11:10 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-d07fc752-986d-4a92-9ed1-14f2660e2e97 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653" status: 200 len: 1502 microversion: 2.1 time: 0.221873 Apr 13 15:11:10 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 89/268] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:11:10 2023] GET /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653 => generated 1502 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 15:11:11 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-b86e082d-1a9f-4695-961a-0b303f884c3a req-b50c14b6-45e9-4d4b-b54d-861a18f8aabb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff", "tag": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b86e082d-1a9f-4695-961a-0b303f884c3a req-b50c14b6-45e9-4d4b-b54d-861a18f8aabb service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b86e082d-1a9f-4695-961a-0b303f884c3a req-b50c14b6-45e9-4d4b-b54d-861a18f8aabb service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b86e082d-1a9f-4695-961a-0b303f884c3a req-b50c14b6-45e9-4d4b-b54d-861a18f8aabb service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:11 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-b86e082d-1a9f-4695-961a-0b303f884c3a req-b50c14b6-45e9-4d4b-b54d-861a18f8aabb service nova] Creating event network-changed:f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff on user Apr 13 15:11:11 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-b86e082d-1a9f-4695-961a-0b303f884c3a req-b50c14b6-45e9-4d4b-b54d-861a18f8aabb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034334 Apr 13 15:11:11 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 94/269] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:11:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:11:12 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-2b1d0ea6-608a-4d86-baf2-7d63ccd88ca3 req-84f84522-461b-4c88-bba2-c194c8aea53d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff", "name": "network-vif-plugged", "status": "completed", "tag": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-2b1d0ea6-608a-4d86-baf2-7d63ccd88ca3 req-84f84522-461b-4c88-bba2-c194c8aea53d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-2b1d0ea6-608a-4d86-baf2-7d63ccd88ca3 req-84f84522-461b-4c88-bba2-c194c8aea53d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-2b1d0ea6-608a-4d86-baf2-7d63ccd88ca3 req-84f84522-461b-4c88-bba2-c194c8aea53d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:12 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-2b1d0ea6-608a-4d86-baf2-7d63ccd88ca3 req-84f84522-461b-4c88-bba2-c194c8aea53d service nova] Creating event network-vif-plugged:f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff on user Apr 13 15:11:12 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-2b1d0ea6-608a-4d86-baf2-7d63ccd88ca3 req-84f84522-461b-4c88-bba2-c194c8aea53d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029721 Apr 13 15:11:12 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 87/270] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:11:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:11:13 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-7d5da8b1-ee01-4bb0-81f0-3b2e71acf16e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:13 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-7d5da8b1-ee01-4bb0-81f0-3b2e71acf16e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:13 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7d5da8b1-ee01-4bb0-81f0-3b2e71acf16e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:13 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7d5da8b1-ee01-4bb0-81f0-3b2e71acf16e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:13 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7d5da8b1-ee01-4bb0-81f0-3b2e71acf16e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:13 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7d5da8b1-ee01-4bb0-81f0-3b2e71acf16e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:13 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7d5da8b1-ee01-4bb0-81f0-3b2e71acf16e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:13 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7d5da8b1-ee01-4bb0-81f0-3b2e71acf16e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:13 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-7d5da8b1-ee01-4bb0-81f0-3b2e71acf16e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] HTTP exception thrown: Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 could not be found. Apr 13 15:11:13 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-7d5da8b1-ee01-4bb0-81f0-3b2e71acf16e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Request method failure captured: Apr 13 15:11:13 user devstack@n-api.service[61872]: request: DELETE /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944 HTTP/1.1 Apr 13 15:11:13 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:11:13 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:11:13 user devstack@n-api.service[61872]: Connection: close Apr 13 15:11:13 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:11:13 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:11:13 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:11:13 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:11:13 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:11:13 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBqpQ9IZLxeXr6vTE0vMTDJZ2UqZEPzykufIr3qfIzTrYfcfReZI88jA_oeZP26qARPntxMYCOPsISLESBpGPCoDkrsQwmmY5-n_7qXjsi0_WFYOWW3aBfS7o85IQqPLyWroEu_BLWlEoNmID-meVm0qn6B2KqzZPTah3FdxCK1umpg Apr 13 15:11:13 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:11:13 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:11:13 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:11:13 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:11:13 user devstack@n-api.service[61872]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 15:11:13 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:11:13 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:11:13 user devstack@n-api.service[61872]: X-Project-Id: d530eb6a4bf04f468299323520f56d1d Apr 13 15:11:13 user devstack@n-api.service[61872]: X-Project-Name: tempest-TaggedBootDevicesTest-1120084057 Apr 13 15:11:13 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:11:13 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:11:13 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d530eb6a4bf04f468299323520f56d1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d530eb6a4bf04f468299323520f56d1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d530eb6a4bf04f468299323520f56d1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:11:13 user devstack@n-api.service[61872]: X-Tenant: tempest-TaggedBootDevicesTest-1120084057 Apr 13 15:11:13 user devstack@n-api.service[61872]: X-Tenant-Id: d530eb6a4bf04f468299323520f56d1d Apr 13 15:11:13 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1120084057 Apr 13 15:11:13 user devstack@n-api.service[61872]: X-User: tempest-TaggedBootDevicesTest-1120084057-project-member Apr 13 15:11:13 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:11:13 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:11:13 user devstack@n-api.service[61872]: X-User-Id: 40c18c8a515b457088a9901fbc86629f Apr 13 15:11:13 user devstack@n-api.service[61872]: X-User-Name: tempest-TaggedBootDevicesTest-1120084057-project-member Apr 13 15:11:13 user devstack@n-api.service[61872]: method: > Apr 13 15:11:13 user devstack@n-api.service[61872]: exception: Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 could not be found. Apr 13 15:11:13 user devstack@n-api.service[61872]: action_args: {'id': 'e84c85a8-b97d-44ac-b0b3-f898860f5944'} Apr 13 15:11:13 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 could not be found. Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 could not be found. Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 could not be found. Apr 13 15:11:13 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:11:13 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-7d5da8b1-ee01-4bb0-81f0-3b2e71acf16e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Returning 404 to user: Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:11:13 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-7d5da8b1-ee01-4bb0-81f0-3b2e71acf16e tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944" status: 404 len: 111 microversion: 2.32 time: 0.115216 Apr 13 15:11:13 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 90/271] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 15:11:13 2023] DELETE /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:11:13 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c1155766-74f5-43e9-8572-a1acb165ad3c tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:13 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-c1155766-74f5-43e9-8572-a1acb165ad3c tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c1155766-74f5-43e9-8572-a1acb165ad3c tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c1155766-74f5-43e9-8572-a1acb165ad3c tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c1155766-74f5-43e9-8572-a1acb165ad3c tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c1155766-74f5-43e9-8572-a1acb165ad3c tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c1155766-74f5-43e9-8572-a1acb165ad3c tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c1155766-74f5-43e9-8572-a1acb165ad3c tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:13 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-c1155766-74f5-43e9-8572-a1acb165ad3c tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] HTTP exception thrown: Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 could not be found. Apr 13 15:11:13 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c1155766-74f5-43e9-8572-a1acb165ad3c tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Request method failure captured: Apr 13 15:11:13 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944 HTTP/1.1 Apr 13 15:11:13 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:11:13 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:11:13 user devstack@n-api.service[61873]: Connection: close Apr 13 15:11:13 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:11:13 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:11:13 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:11:13 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:11:13 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:11:13 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBqpQ9IZLxeXr6vTE0vMTDJZ2UqZEPzykufIr3qfIzTrYfcfReZI88jA_oeZP26qARPntxMYCOPsISLESBpGPCoDkrsQwmmY5-n_7qXjsi0_WFYOWW3aBfS7o85IQqPLyWroEu_BLWlEoNmID-meVm0qn6B2KqzZPTah3FdxCK1umpg Apr 13 15:11:13 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:11:13 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:11:13 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:11:13 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:11:13 user devstack@n-api.service[61873]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 15:11:13 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:11:13 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:11:13 user devstack@n-api.service[61873]: X-Project-Id: d530eb6a4bf04f468299323520f56d1d Apr 13 15:11:13 user devstack@n-api.service[61873]: X-Project-Name: tempest-TaggedBootDevicesTest-1120084057 Apr 13 15:11:13 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:11:13 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:11:13 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d530eb6a4bf04f468299323520f56d1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d530eb6a4bf04f468299323520f56d1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d530eb6a4bf04f468299323520f56d1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:11:13 user devstack@n-api.service[61873]: X-Tenant: tempest-TaggedBootDevicesTest-1120084057 Apr 13 15:11:13 user devstack@n-api.service[61873]: X-Tenant-Id: d530eb6a4bf04f468299323520f56d1d Apr 13 15:11:13 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1120084057 Apr 13 15:11:13 user devstack@n-api.service[61873]: X-User: tempest-TaggedBootDevicesTest-1120084057-project-member Apr 13 15:11:13 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:11:13 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:11:13 user devstack@n-api.service[61873]: X-User-Id: 40c18c8a515b457088a9901fbc86629f Apr 13 15:11:13 user devstack@n-api.service[61873]: X-User-Name: tempest-TaggedBootDevicesTest-1120084057-project-member Apr 13 15:11:13 user devstack@n-api.service[61873]: method: > Apr 13 15:11:13 user devstack@n-api.service[61873]: exception: Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 could not be found. Apr 13 15:11:13 user devstack@n-api.service[61873]: action_args: {'id': 'e84c85a8-b97d-44ac-b0b3-f898860f5944'} Apr 13 15:11:13 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 could not be found. Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 could not be found. Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 could not be found. Apr 13 15:11:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:11:13 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c1155766-74f5-43e9-8572-a1acb165ad3c tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Returning 404 to user: Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:11:13 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-c1155766-74f5-43e9-8572-a1acb165ad3c tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944" status: 404 len: 111 microversion: 2.32 time: 0.031847 Apr 13 15:11:13 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 95/272] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:11:13 2023] GET /compute/v2.1/servers/e84c85a8-b97d-44ac-b0b3-f898860f5944 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:11:15 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-084873fb-148c-44be-ab13-a32aa2ada2f3 req-28aa2689-a12b-470b-bf62-bc87e76a2264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff", "name": "network-vif-plugged", "status": "completed", "tag": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-084873fb-148c-44be-ab13-a32aa2ada2f3 req-28aa2689-a12b-470b-bf62-bc87e76a2264 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-084873fb-148c-44be-ab13-a32aa2ada2f3 req-28aa2689-a12b-470b-bf62-bc87e76a2264 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-084873fb-148c-44be-ab13-a32aa2ada2f3 req-28aa2689-a12b-470b-bf62-bc87e76a2264 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:15 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-084873fb-148c-44be-ab13-a32aa2ada2f3 req-28aa2689-a12b-470b-bf62-bc87e76a2264 service nova] Creating event network-vif-plugged:f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff on user Apr 13 15:11:15 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-084873fb-148c-44be-ab13-a32aa2ada2f3 req-28aa2689-a12b-470b-bf62-bc87e76a2264 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029629 Apr 13 15:11:15 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 88/273] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:11:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:11:23 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:23 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=10 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:23 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-5849d1af-376e-4f35-8009-4ecc3040ffef tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:23 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-5849d1af-376e-4f35-8009-4ecc3040ffef tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5849d1af-376e-4f35-8009-4ecc3040ffef tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5849d1af-376e-4f35-8009-4ecc3040ffef tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5849d1af-376e-4f35-8009-4ecc3040ffef tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5849d1af-376e-4f35-8009-4ecc3040ffef tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5849d1af-376e-4f35-8009-4ecc3040ffef tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5849d1af-376e-4f35-8009-4ecc3040ffef tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:23 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-5849d1af-376e-4f35-8009-4ecc3040ffef tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30a69b780664742aed58bd9a578e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5acb52755c74d118d012e38feed7237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:11:23 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-5849d1af-376e-4f35-8009-4ecc3040ffef tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818" status: 200 len: 1672 microversion: 2.1 time: 0.147835 Apr 13 15:11:23 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 91/274] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:11:23 2023] GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:11:23 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-cf20002f-4bbf-49e0-a48a-3eb4df5c93d3 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:23 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-cf20002f-4bbf-49e0-a48a-3eb4df5c93d3 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:23 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:23 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:23 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cf20002f-4bbf-49e0-a48a-3eb4df5c93d3 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cf20002f-4bbf-49e0-a48a-3eb4df5c93d3 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cf20002f-4bbf-49e0-a48a-3eb4df5c93d3 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cf20002f-4bbf-49e0-a48a-3eb4df5c93d3 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cf20002f-4bbf-49e0-a48a-3eb4df5c93d3 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cf20002f-4bbf-49e0-a48a-3eb4df5c93d3 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:23 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-cf20002f-4bbf-49e0-a48a-3eb4df5c93d3 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:11:23 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-cf20002f-4bbf-49e0-a48a-3eb4df5c93d3 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:11:23 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-cf20002f-4bbf-49e0-a48a-3eb4df5c93d3 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:11:23 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-cf20002f-4bbf-49e0-a48a-3eb4df5c93d3 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473" status: 200 len: 1768 microversion: 2.87 time: 0.221019 Apr 13 15:11:23 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 96/275] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:11:23 2023] GET /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473 => generated 1768 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:11:24 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5579543e-1e86-4db2-b6b5-4a2ff31d59b1"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:24 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:24 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:24 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=36 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:25 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "POST /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362462 Apr 13 15:11:25 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 89/276] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:11:24 2023] POST /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:11:25 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-8f8b1aaf-d69d-42c8-aa5b-7d55ab9adc78 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:25 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-8f8b1aaf-d69d-42c8-aa5b-7d55ab9adc78 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:25 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8f8b1aaf-d69d-42c8-aa5b-7d55ab9adc78 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:25 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8f8b1aaf-d69d-42c8-aa5b-7d55ab9adc78 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:25 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8f8b1aaf-d69d-42c8-aa5b-7d55ab9adc78 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:25 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8f8b1aaf-d69d-42c8-aa5b-7d55ab9adc78 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:25 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8f8b1aaf-d69d-42c8-aa5b-7d55ab9adc78 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:25 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8f8b1aaf-d69d-42c8-aa5b-7d55ab9adc78 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:25 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-8f8b1aaf-d69d-42c8-aa5b-7d55ab9adc78 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] 10.0.0.210 "GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045192 Apr 13 15:11:25 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 92/277] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:11:25 2023] GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:11:25 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:25 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:25 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Going to try to terminate instance {{(pid=61873) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:11:25 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd" status: 204 len: 0 microversion: 2.1 time: 0.103268 Apr 13 15:11:25 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 97/278] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:11:25 2023] DELETE /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:11:25 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-0f3512a2-d957-4dfb-ae27-eca416faa135 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:25 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-0f3512a2-d957-4dfb-ae27-eca416faa135 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0f3512a2-d957-4dfb-ae27-eca416faa135 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0f3512a2-d957-4dfb-ae27-eca416faa135 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0f3512a2-d957-4dfb-ae27-eca416faa135 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0f3512a2-d957-4dfb-ae27-eca416faa135 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0f3512a2-d957-4dfb-ae27-eca416faa135 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0f3512a2-d957-4dfb-ae27-eca416faa135 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:26 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-0f3512a2-d957-4dfb-ae27-eca416faa135 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2141a10d4f543fdaab261486c7e7221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27787b48c024464091785f8308d8733e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:11:26 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-0f3512a2-d957-4dfb-ae27-eca416faa135 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] 10.0.0.210 "GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd" status: 200 len: 1647 microversion: 2.1 time: 0.202800 Apr 13 15:11:26 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 90/279] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:11:25 2023] GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd => generated 1647 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:11:26 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-1623106c-2626-49d2-93f7-34486bbc2388 req-0f063e6f-0d63-45ed-9fa7-89aa4b8dc78d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "193136fc-e6c3-4e70-b7ab-01ced440c6bd", "name": "network-vif-unplugged", "status": "completed", "tag": "49eab8a0-3140-4872-b606-e03f2a243e2f"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-1623106c-2626-49d2-93f7-34486bbc2388 req-0f063e6f-0d63-45ed-9fa7-89aa4b8dc78d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-1623106c-2626-49d2-93f7-34486bbc2388 req-0f063e6f-0d63-45ed-9fa7-89aa4b8dc78d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-1623106c-2626-49d2-93f7-34486bbc2388 req-0f063e6f-0d63-45ed-9fa7-89aa4b8dc78d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:26 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-1623106c-2626-49d2-93f7-34486bbc2388 req-0f063e6f-0d63-45ed-9fa7-89aa4b8dc78d service nova] Creating event network-vif-unplugged:49eab8a0-3140-4872-b606-e03f2a243e2f for instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd on user Apr 13 15:11:26 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-1623106c-2626-49d2-93f7-34486bbc2388 req-0f063e6f-0d63-45ed-9fa7-89aa4b8dc78d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061542 Apr 13 15:11:26 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 93/280] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:11:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:11:27 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-1c7e1e7d-5afc-4fae-aaad-9d1da281d2d5 req-a6763da2-7e63-4ab1-81f3-cf5eb1b14e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "193136fc-e6c3-4e70-b7ab-01ced440c6bd", "name": "network-vif-deleted", "tag": "49eab8a0-3140-4872-b606-e03f2a243e2f"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-1c7e1e7d-5afc-4fae-aaad-9d1da281d2d5 req-a6763da2-7e63-4ab1-81f3-cf5eb1b14e4b service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-1c7e1e7d-5afc-4fae-aaad-9d1da281d2d5 req-a6763da2-7e63-4ab1-81f3-cf5eb1b14e4b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-1c7e1e7d-5afc-4fae-aaad-9d1da281d2d5 req-a6763da2-7e63-4ab1-81f3-cf5eb1b14e4b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:27 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-1c7e1e7d-5afc-4fae-aaad-9d1da281d2d5 req-a6763da2-7e63-4ab1-81f3-cf5eb1b14e4b service nova] Creating event network-vif-deleted:49eab8a0-3140-4872-b606-e03f2a243e2f for instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd on user Apr 13 15:11:27 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-1c7e1e7d-5afc-4fae-aaad-9d1da281d2d5 req-a6763da2-7e63-4ab1-81f3-cf5eb1b14e4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035295 Apr 13 15:11:27 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 98/281] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:11:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:11:28 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-48dc8846-e93a-4009-b196-5f45cfe6c84b req-261d26ec-d8aa-48db-99e0-a4fd67d96611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "193136fc-e6c3-4e70-b7ab-01ced440c6bd", "name": "network-vif-plugged", "status": "completed", "tag": "49eab8a0-3140-4872-b606-e03f2a243e2f"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-48dc8846-e93a-4009-b196-5f45cfe6c84b req-261d26ec-d8aa-48db-99e0-a4fd67d96611 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-48dc8846-e93a-4009-b196-5f45cfe6c84b req-261d26ec-d8aa-48db-99e0-a4fd67d96611 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-48dc8846-e93a-4009-b196-5f45cfe6c84b req-261d26ec-d8aa-48db-99e0-a4fd67d96611 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:28 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-48dc8846-e93a-4009-b196-5f45cfe6c84b req-261d26ec-d8aa-48db-99e0-a4fd67d96611 service nova] Creating event network-vif-plugged:49eab8a0-3140-4872-b606-e03f2a243e2f for instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd on user Apr 13 15:11:28 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-48dc8846-e93a-4009-b196-5f45cfe6c84b req-261d26ec-d8aa-48db-99e0-a4fd67d96611 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038568 Apr 13 15:11:28 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 91/282] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:11:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:11:32 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "b09d887d-e4fc-48c4-a1b4-8c026c0de9fc"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:32 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:32 user devstack@n-api.service[61872]: DEBUG nova.objects.instance [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lazy-loading 'flavor' on Instance uuid 654608ee-5897-429a-b19c-6845d4e84818 {{(pid=61872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:11:33 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "POST /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818/action" status: 200 len: 29 microversion: 2.1 time: 0.204092 Apr 13 15:11:33 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 94/283] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:11:32 2023] POST /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818/action => generated 29 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:11:33 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-6be7e976-93c7-44d1-851d-60476841f314 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:33 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-6be7e976-93c7-44d1-851d-60476841f314 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-6be7e976-93c7-44d1-851d-60476841f314 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-6be7e976-93c7-44d1-851d-60476841f314 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-6be7e976-93c7-44d1-851d-60476841f314 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-6be7e976-93c7-44d1-851d-60476841f314 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-6be7e976-93c7-44d1-851d-60476841f314 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-6be7e976-93c7-44d1-851d-60476841f314 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:33 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-6be7e976-93c7-44d1-851d-60476841f314 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30a69b780664742aed58bd9a578e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5acb52755c74d118d012e38feed7237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:11:33 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-6be7e976-93c7-44d1-851d-60476841f314 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818" status: 200 len: 1724 microversion: 2.1 time: 0.255201 Apr 13 15:11:33 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 99/284] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:11:33 2023] GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:11:34 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-93b0bd28-d534-437d-a165-8cae822282a9 req-411d8562-2f69-4b49-a204-12f735e67a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "name": "network-vif-unplugged", "status": "completed", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-93b0bd28-d534-437d-a165-8cae822282a9 req-411d8562-2f69-4b49-a204-12f735e67a42 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-93b0bd28-d534-437d-a165-8cae822282a9 req-411d8562-2f69-4b49-a204-12f735e67a42 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-93b0bd28-d534-437d-a165-8cae822282a9 req-411d8562-2f69-4b49-a204-12f735e67a42 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:34 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-93b0bd28-d534-437d-a165-8cae822282a9 req-411d8562-2f69-4b49-a204-12f735e67a42 service nova] Creating event network-vif-unplugged:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:11:34 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-93b0bd28-d534-437d-a165-8cae822282a9 req-411d8562-2f69-4b49-a204-12f735e67a42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032172 Apr 13 15:11:34 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 92/285] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:11:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:11:36 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-7c642c0c-c238-446c-beee-792e5de17254 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:36 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-7c642c0c-c238-446c-beee-792e5de17254 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7c642c0c-c238-446c-beee-792e5de17254 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7c642c0c-c238-446c-beee-792e5de17254 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7c642c0c-c238-446c-beee-792e5de17254 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7c642c0c-c238-446c-beee-792e5de17254 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7c642c0c-c238-446c-beee-792e5de17254 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7c642c0c-c238-446c-beee-792e5de17254 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:36 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "name": "network-vif-plugged", "status": "completed", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}, {"server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "name": "network-vif-plugged", "status": "completed", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}, {"server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "name": "network-vif-plugged", "status": "completed", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}, {"server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "name": "network-vif-unplugged", "status": "completed", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:36 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Creating event network-vif-plugged:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:11:36 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Creating event network-vif-plugged:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:11:36 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Creating event network-vif-plugged:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:11:36 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Creating event network-vif-unplugged:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:11:36 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.036145 Apr 13 15:11:36 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 100/286] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:11:36 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:11:36 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-7c642c0c-c238-446c-beee-792e5de17254 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc0cce3df7540078438186f46ca4621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7227559570b54e92be19d25938523b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:11:36 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-7c642c0c-c238-446c-beee-792e5de17254 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211" status: 200 len: 1499 microversion: 2.1 time: 0.161540 Apr 13 15:11:36 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 95/287] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:11:36 2023] GET /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211 => generated 1499 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:11:38 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-cf5b8d16-c03e-4ec7-91d7-ac5e2294ade5 req-0d448b5c-a0b8-4483-8ca5-911e991b2583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "name": "network-vif-plugged", "status": "completed", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-cf5b8d16-c03e-4ec7-91d7-ac5e2294ade5 req-0d448b5c-a0b8-4483-8ca5-911e991b2583 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-cf5b8d16-c03e-4ec7-91d7-ac5e2294ade5 req-0d448b5c-a0b8-4483-8ca5-911e991b2583 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-cf5b8d16-c03e-4ec7-91d7-ac5e2294ade5 req-0d448b5c-a0b8-4483-8ca5-911e991b2583 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:38 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-cf5b8d16-c03e-4ec7-91d7-ac5e2294ade5 req-0d448b5c-a0b8-4483-8ca5-911e991b2583 service nova] Creating event network-vif-plugged:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:11:38 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-cf5b8d16-c03e-4ec7-91d7-ac5e2294ade5 req-0d448b5c-a0b8-4483-8ca5-911e991b2583 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034066 Apr 13 15:11:38 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 93/288] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:11:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:11:39 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-8bd87927-9d17-4156-b7b4-99b5ef9559c7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Action: 'create', calling method: .version_select at 0x7f3a8ba039a0>, body: {"keypair": {"name": "tempest-keypair-164816521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA=="}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:39 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-8bd87927-9d17-4156-b7b4-99b5ef9559c7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting quotas for project 9154e4239a1a42a3820c27563ba0513f. Resources: {'key_pairs'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:11:39 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-8bd87927-9d17-4156-b7b4-99b5ef9559c7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting quotas for user 3c12c62d4137473596571e523163e718 and project 9154e4239a1a42a3820c27563ba0513f. Resources: {'key_pairs'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:11:39 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-8bd87927-9d17-4156-b7b4-99b5ef9559c7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.160301 Apr 13 15:11:39 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 101/289] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 15:11:39 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:11:40 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-98afde29-5ee5-4716-8ab5-bffacb3ec1d9 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:40 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-98afde29-5ee5-4716-8ab5-bffacb3ec1d9 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:40 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-98afde29-5ee5-4716-8ab5-bffacb3ec1d9 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-98afde29-5ee5-4716-8ab5-bffacb3ec1d9 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-98afde29-5ee5-4716-8ab5-bffacb3ec1d9 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-98afde29-5ee5-4716-8ab5-bffacb3ec1d9 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-98afde29-5ee5-4716-8ab5-bffacb3ec1d9 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-98afde29-5ee5-4716-8ab5-bffacb3ec1d9 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:40 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:40 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-98afde29-5ee5-4716-8ab5-bffacb3ec1d9 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc942f33ca46c08bb143ed2efeb458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0cae04ab4b4157a7ef786d165789a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:11:40 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-98afde29-5ee5-4716-8ab5-bffacb3ec1d9 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c9a3524-caeb-4333-ae2b-1080115026fd" status: 200 len: 1486 microversion: 2.1 time: 0.191799 Apr 13 15:11:40 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 96/290] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:11:40 2023] GET /compute/v2.1/servers/1c9a3524-caeb-4333-ae2b-1080115026fd => generated 1486 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:11:40 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-e61a3cfb-65b1-49a5-9db1-b67a2b301c84 req-e994acaa-c294-49f4-85e9-57d7d547ed97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "name": "network-vif-plugged", "status": "completed", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}, {"server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "name": "network-vif-plugged", "status": "completed", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-e61a3cfb-65b1-49a5-9db1-b67a2b301c84 req-e994acaa-c294-49f4-85e9-57d7d547ed97 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-e61a3cfb-65b1-49a5-9db1-b67a2b301c84 req-e994acaa-c294-49f4-85e9-57d7d547ed97 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-e61a3cfb-65b1-49a5-9db1-b67a2b301c84 req-e994acaa-c294-49f4-85e9-57d7d547ed97 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:40 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-e61a3cfb-65b1-49a5-9db1-b67a2b301c84 req-e994acaa-c294-49f4-85e9-57d7d547ed97 service nova] Creating event network-vif-plugged:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:11:40 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-e61a3cfb-65b1-49a5-9db1-b67a2b301c84 req-e994acaa-c294-49f4-85e9-57d7d547ed97 service nova] Creating event network-vif-plugged:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:11:40 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-e61a3cfb-65b1-49a5-9db1-b67a2b301c84 req-e994acaa-c294-49f4-85e9-57d7d547ed97 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033882 Apr 13 15:11:40 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 94/291] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:11:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:11:41 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1163510400", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4ed78a75-b065-400b-8eb2-71085d406a1e"}], "security_groups": [{"name": "tempest-securitygroup--1561728944"}], "key_name": "tempest-keypair-164816521", "user_data": "}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:41 user devstack@n-api.service[61873]: DEBUG nova.network.neutron [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] validate_networks() for [('4ed78a75-b065-400b-8eb2-71085d406a1e', None, None, None, None, None)] {{(pid=61873) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:11:41 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:11:41 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:11:41 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:11:41 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:11:41 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:11:41 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:41 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:41 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:41 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:41 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:41 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:41 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting quotas for project 9154e4239a1a42a3820c27563ba0513f. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:11:41 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting quotas for user 3c12c62d4137473596571e523163e718 and project 9154e4239a1a42a3820c27563ba0513f. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:11:41 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Going to run 1 instances... {{(pid=61873) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:11:41 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:11:41 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.548939 Apr 13 15:11:41 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 102/292] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:11:41 2023] POST /compute/v2.1/servers => generated 407 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:11:41 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-605a8458-9193-44fd-bacf-b95d7d8e0589 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:41 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-605a8458-9193-44fd-bacf-b95d7d8e0589 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:41 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-605a8458-9193-44fd-bacf-b95d7d8e0589 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:11:41 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-605a8458-9193-44fd-bacf-b95d7d8e0589 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1232 microversion: 2.1 time: 0.068313 Apr 13 15:11:41 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 97/293] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:11:41 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1232 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:11:42 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-cd3b21c6-0663-49e1-94c1-4c4c82861a0a tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:42 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-cd3b21c6-0663-49e1-94c1-4c4c82861a0a tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:42 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cd3b21c6-0663-49e1-94c1-4c4c82861a0a tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:42 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cd3b21c6-0663-49e1-94c1-4c4c82861a0a tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:42 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cd3b21c6-0663-49e1-94c1-4c4c82861a0a tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:42 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cd3b21c6-0663-49e1-94c1-4c4c82861a0a tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:42 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cd3b21c6-0663-49e1-94c1-4c4c82861a0a tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:42 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cd3b21c6-0663-49e1-94c1-4c4c82861a0a tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:43 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-cd3b21c6-0663-49e1-94c1-4c4c82861a0a tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b07929cf2c404ab10ce944437e9e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7b81912360422a8413f8760b0cf7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:11:43 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-cd3b21c6-0663-49e1-94c1-4c4c82861a0a tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfc41492-c482-4a9f-8a5b-9d7520dea39a" status: 200 len: 1495 microversion: 2.1 time: 0.181821 Apr 13 15:11:43 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 95/294] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:11:42 2023] GET /compute/v2.1/servers/bfc41492-c482-4a9f-8a5b-9d7520dea39a => generated 1495 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 15:11:44 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-405a21f8-bccc-42fd-b751-5e2e79f7d7e3 req-d75d417f-16b5-41b1-bd66-91a9bfd18d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc7b5bd-5f78-448e-bd82-74b2263dff75", "tag": "9c8ad360-aa62-4ef1-952f-d73f885baa89"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:44 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-405a21f8-bccc-42fd-b751-5e2e79f7d7e3 req-d75d417f-16b5-41b1-bd66-91a9bfd18d8d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:44 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-405a21f8-bccc-42fd-b751-5e2e79f7d7e3 req-d75d417f-16b5-41b1-bd66-91a9bfd18d8d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:44 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-405a21f8-bccc-42fd-b751-5e2e79f7d7e3 req-d75d417f-16b5-41b1-bd66-91a9bfd18d8d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:44 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-405a21f8-bccc-42fd-b751-5e2e79f7d7e3 req-d75d417f-16b5-41b1-bd66-91a9bfd18d8d service nova] Creating event network-changed:9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 on user Apr 13 15:11:44 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-405a21f8-bccc-42fd-b751-5e2e79f7d7e3 req-d75d417f-16b5-41b1-bd66-91a9bfd18d8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038108 Apr 13 15:11:44 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 103/295] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:11:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:11:46 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-6213f172-b650-480c-9c42-880065867251 req-59c5a075-98ec-4e53-8915-a3843535b236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b5bd-5f78-448e-bd82-74b2263dff75", "name": "network-vif-plugged", "status": "completed", "tag": "9c8ad360-aa62-4ef1-952f-d73f885baa89"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-6213f172-b650-480c-9c42-880065867251 req-59c5a075-98ec-4e53-8915-a3843535b236 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-6213f172-b650-480c-9c42-880065867251 req-59c5a075-98ec-4e53-8915-a3843535b236 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-6213f172-b650-480c-9c42-880065867251 req-59c5a075-98ec-4e53-8915-a3843535b236 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:46 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-6213f172-b650-480c-9c42-880065867251 req-59c5a075-98ec-4e53-8915-a3843535b236 service nova] Creating event network-vif-plugged:9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 on user Apr 13 15:11:46 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-6213f172-b650-480c-9c42-880065867251 req-59c5a075-98ec-4e53-8915-a3843535b236 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064076 Apr 13 15:11:46 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 98/296] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:11:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:11:48 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-eab6129c-8982-49f4-b52a-319dfb19de01 req-70593c1a-6f6a-4d80-a270-87b056f49f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b5bd-5f78-448e-bd82-74b2263dff75", "name": "network-vif-plugged", "status": "completed", "tag": "9c8ad360-aa62-4ef1-952f-d73f885baa89"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:11:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-eab6129c-8982-49f4-b52a-319dfb19de01 req-70593c1a-6f6a-4d80-a270-87b056f49f5a service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-eab6129c-8982-49f4-b52a-319dfb19de01 req-70593c1a-6f6a-4d80-a270-87b056f49f5a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-eab6129c-8982-49f4-b52a-319dfb19de01 req-70593c1a-6f6a-4d80-a270-87b056f49f5a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:48 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-eab6129c-8982-49f4-b52a-319dfb19de01 req-70593c1a-6f6a-4d80-a270-87b056f49f5a service nova] Creating event network-vif-plugged:9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 on user Apr 13 15:11:48 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-eab6129c-8982-49f4-b52a-319dfb19de01 req-70593c1a-6f6a-4d80-a270-87b056f49f5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048407 Apr 13 15:11:48 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 96/297] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:11:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:11:57 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:57 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=10 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:57 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:57 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:57 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f4c80761-d20c-464e-9511-d2db36940e7e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:57 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-f4c80761-d20c-464e-9511-d2db36940e7e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f4c80761-d20c-464e-9511-d2db36940e7e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f4c80761-d20c-464e-9511-d2db36940e7e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f4c80761-d20c-464e-9511-d2db36940e7e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f4c80761-d20c-464e-9511-d2db36940e7e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f4c80761-d20c-464e-9511-d2db36940e7e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f4c80761-d20c-464e-9511-d2db36940e7e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:57 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-f4c80761-d20c-464e-9511-d2db36940e7e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] HTTP exception thrown: Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc could not be found. Apr 13 15:11:57 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f4c80761-d20c-464e-9511-d2db36940e7e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Request method failure captured: Apr 13 15:11:57 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc HTTP/1.1 Apr 13 15:11:57 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:11:57 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:11:57 user devstack@n-api.service[61873]: Connection: close Apr 13 15:11:57 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:11:57 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:11:57 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:11:57 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:11:57 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:11:57 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBqzVDIiESL9GYR-1XCzk9zBNFR52d-qU9Xu3va65aMmjCO7wCRtkjfNI9NwlqF7z_FuDFJK3SG8iLhIkr49lObXCPMRt9y79WZXIOCP8BCtyDms9meFR5c9jcvZPUAFINz0NDqE6y6wHIXExXsC4_OQvj6q7doX2V_F7CckcwIP-jA Apr 13 15:11:57 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:11:57 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:11:57 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:11:57 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:11:57 user devstack@n-api.service[61873]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 15:11:57 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:11:57 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:11:57 user devstack@n-api.service[61873]: X-Project-Id: be23bf27d7ed4f0abf2fdc60ae1edb71 Apr 13 15:11:57 user devstack@n-api.service[61873]: X-Project-Name: tempest-TaggedAttachmentsTest-227294207 Apr 13 15:11:57 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:11:57 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:11:57 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/be23bf27d7ed4f0abf2fdc60ae1edb71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be23bf27d7ed4f0abf2fdc60ae1edb71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be23bf27d7ed4f0abf2fdc60ae1edb71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:11:57 user devstack@n-api.service[61873]: X-Tenant: tempest-TaggedAttachmentsTest-227294207 Apr 13 15:11:57 user devstack@n-api.service[61873]: X-Tenant-Id: be23bf27d7ed4f0abf2fdc60ae1edb71 Apr 13 15:11:57 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-TaggedAttachmentsTest-227294207 Apr 13 15:11:57 user devstack@n-api.service[61873]: X-User: tempest-TaggedAttachmentsTest-227294207-project-member Apr 13 15:11:57 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:11:57 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:11:57 user devstack@n-api.service[61873]: X-User-Id: 5b59f4d6492a4821a621b18766bf58fa Apr 13 15:11:57 user devstack@n-api.service[61873]: X-User-Name: tempest-TaggedAttachmentsTest-227294207-project-member Apr 13 15:11:57 user devstack@n-api.service[61873]: method: > Apr 13 15:11:57 user devstack@n-api.service[61873]: exception: Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc could not be found. Apr 13 15:11:57 user devstack@n-api.service[61873]: action_args: {'id': '95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc'} Apr 13 15:11:57 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc could not be found. Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc could not be found. Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc could not be found. Apr 13 15:11:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:11:57 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f4c80761-d20c-464e-9511-d2db36940e7e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Returning 404 to user: Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:11:57 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-f4c80761-d20c-464e-9511-d2db36940e7e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" status: 404 len: 111 microversion: 2.49 time: 0.039544 Apr 13 15:11:57 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 104/298] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:11:57 2023] GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:11:57 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:57 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=7 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:57 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=7 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:57 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-39bb50bd-15c2-4f38-a302-b2f16bae299b tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Calling method '.version_select at 0x7f3a8fa5ce50>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:57 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-39bb50bd-15c2-4f38-a302-b2f16bae299b tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1905935028" status: 204 len: 0 microversion: 2.49 time: 0.049525 Apr 13 15:11:57 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 99/299] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 13 15:11:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1905935028 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 15:11:57 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-a98df5f6-3735-431f-91fa-4b0f05cac8f9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:57 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-a98df5f6-3735-431f-91fa-4b0f05cac8f9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:57 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=16 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a98df5f6-3735-431f-91fa-4b0f05cac8f9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a98df5f6-3735-431f-91fa-4b0f05cac8f9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a98df5f6-3735-431f-91fa-4b0f05cac8f9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a98df5f6-3735-431f-91fa-4b0f05cac8f9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a98df5f6-3735-431f-91fa-4b0f05cac8f9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a98df5f6-3735-431f-91fa-4b0f05cac8f9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:57 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:11:58 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-a98df5f6-3735-431f-91fa-4b0f05cac8f9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:11:58 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-a98df5f6-3735-431f-91fa-4b0f05cac8f9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" status: 200 len: 1535 microversion: 2.1 time: 0.296710 Apr 13 15:11:58 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 97/300] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:11:57 2023] GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff => generated 1535 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:11:59 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-38be73ae-ff41-4c51-a1b6-60e7b1830676 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:59 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-38be73ae-ff41-4c51-a1b6-60e7b1830676 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-38be73ae-ff41-4c51-a1b6-60e7b1830676 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-38be73ae-ff41-4c51-a1b6-60e7b1830676 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-38be73ae-ff41-4c51-a1b6-60e7b1830676 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-38be73ae-ff41-4c51-a1b6-60e7b1830676 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-38be73ae-ff41-4c51-a1b6-60e7b1830676 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-38be73ae-ff41-4c51-a1b6-60e7b1830676 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:59 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-38be73ae-ff41-4c51-a1b6-60e7b1830676 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] HTTP exception thrown: Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc could not be found. Apr 13 15:11:59 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-38be73ae-ff41-4c51-a1b6-60e7b1830676 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Request method failure captured: Apr 13 15:11:59 user devstack@n-api.service[61873]: request: DELETE /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc HTTP/1.1 Apr 13 15:11:59 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:11:59 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:11:59 user devstack@n-api.service[61873]: Connection: close Apr 13 15:11:59 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:11:59 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:11:59 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:11:59 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:11:59 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:11:59 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBqzVDIiESL9GYR-1XCzk9zBNFR52d-qU9Xu3va65aMmjCO7wCRtkjfNI9NwlqF7z_FuDFJK3SG8iLhIkr49lObXCPMRt9y79WZXIOCP8BCtyDms9meFR5c9jcvZPUAFINz0NDqE6y6wHIXExXsC4_OQvj6q7doX2V_F7CckcwIP-jA Apr 13 15:11:59 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:11:59 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:11:59 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:11:59 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:11:59 user devstack@n-api.service[61873]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 15:11:59 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:11:59 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:11:59 user devstack@n-api.service[61873]: X-Project-Id: be23bf27d7ed4f0abf2fdc60ae1edb71 Apr 13 15:11:59 user devstack@n-api.service[61873]: X-Project-Name: tempest-TaggedAttachmentsTest-227294207 Apr 13 15:11:59 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:11:59 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:11:59 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/be23bf27d7ed4f0abf2fdc60ae1edb71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be23bf27d7ed4f0abf2fdc60ae1edb71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be23bf27d7ed4f0abf2fdc60ae1edb71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:11:59 user devstack@n-api.service[61873]: X-Tenant: tempest-TaggedAttachmentsTest-227294207 Apr 13 15:11:59 user devstack@n-api.service[61873]: X-Tenant-Id: be23bf27d7ed4f0abf2fdc60ae1edb71 Apr 13 15:11:59 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-TaggedAttachmentsTest-227294207 Apr 13 15:11:59 user devstack@n-api.service[61873]: X-User: tempest-TaggedAttachmentsTest-227294207-project-member Apr 13 15:11:59 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:11:59 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:11:59 user devstack@n-api.service[61873]: X-User-Id: 5b59f4d6492a4821a621b18766bf58fa Apr 13 15:11:59 user devstack@n-api.service[61873]: X-User-Name: tempest-TaggedAttachmentsTest-227294207-project-member Apr 13 15:11:59 user devstack@n-api.service[61873]: method: > Apr 13 15:11:59 user devstack@n-api.service[61873]: exception: Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc could not be found. Apr 13 15:11:59 user devstack@n-api.service[61873]: action_args: {'id': '95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc'} Apr 13 15:11:59 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc could not be found. Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc could not be found. Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc could not be found. Apr 13 15:11:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:11:59 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-38be73ae-ff41-4c51-a1b6-60e7b1830676 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Returning 404 to user: Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:11:59 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-38be73ae-ff41-4c51-a1b6-60e7b1830676 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" status: 404 len: 111 microversion: 2.49 time: 0.028406 Apr 13 15:11:59 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 105/301] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 15:11:59 2023] DELETE /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:11:59 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-901e2fde-332f-40c7-8232-df0abbf25ec4 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:11:59 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-901e2fde-332f-40c7-8232-df0abbf25ec4 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:11:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-901e2fde-332f-40c7-8232-df0abbf25ec4 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-901e2fde-332f-40c7-8232-df0abbf25ec4 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-901e2fde-332f-40c7-8232-df0abbf25ec4 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-901e2fde-332f-40c7-8232-df0abbf25ec4 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:11:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-901e2fde-332f-40c7-8232-df0abbf25ec4 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:11:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-901e2fde-332f-40c7-8232-df0abbf25ec4 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:11:59 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-901e2fde-332f-40c7-8232-df0abbf25ec4 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] HTTP exception thrown: Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc could not be found. Apr 13 15:11:59 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-901e2fde-332f-40c7-8232-df0abbf25ec4 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Request method failure captured: Apr 13 15:11:59 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc HTTP/1.1 Apr 13 15:11:59 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:11:59 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:11:59 user devstack@n-api.service[61872]: Connection: close Apr 13 15:11:59 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:11:59 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:11:59 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:11:59 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:11:59 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:11:59 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBqzVDIiESL9GYR-1XCzk9zBNFR52d-qU9Xu3va65aMmjCO7wCRtkjfNI9NwlqF7z_FuDFJK3SG8iLhIkr49lObXCPMRt9y79WZXIOCP8BCtyDms9meFR5c9jcvZPUAFINz0NDqE6y6wHIXExXsC4_OQvj6q7doX2V_F7CckcwIP-jA Apr 13 15:11:59 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:11:59 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:11:59 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:11:59 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:11:59 user devstack@n-api.service[61872]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 15:11:59 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:11:59 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:11:59 user devstack@n-api.service[61872]: X-Project-Id: be23bf27d7ed4f0abf2fdc60ae1edb71 Apr 13 15:11:59 user devstack@n-api.service[61872]: X-Project-Name: tempest-TaggedAttachmentsTest-227294207 Apr 13 15:11:59 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:11:59 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:11:59 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/be23bf27d7ed4f0abf2fdc60ae1edb71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be23bf27d7ed4f0abf2fdc60ae1edb71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be23bf27d7ed4f0abf2fdc60ae1edb71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:11:59 user devstack@n-api.service[61872]: X-Tenant: tempest-TaggedAttachmentsTest-227294207 Apr 13 15:11:59 user devstack@n-api.service[61872]: X-Tenant-Id: be23bf27d7ed4f0abf2fdc60ae1edb71 Apr 13 15:11:59 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-TaggedAttachmentsTest-227294207 Apr 13 15:11:59 user devstack@n-api.service[61872]: X-User: tempest-TaggedAttachmentsTest-227294207-project-member Apr 13 15:11:59 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:11:59 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:11:59 user devstack@n-api.service[61872]: X-User-Id: 5b59f4d6492a4821a621b18766bf58fa Apr 13 15:11:59 user devstack@n-api.service[61872]: X-User-Name: tempest-TaggedAttachmentsTest-227294207-project-member Apr 13 15:11:59 user devstack@n-api.service[61872]: method: > Apr 13 15:11:59 user devstack@n-api.service[61872]: exception: Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc could not be found. Apr 13 15:11:59 user devstack@n-api.service[61872]: action_args: {'id': '95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc'} Apr 13 15:11:59 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc could not be found. Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc could not be found. Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc could not be found. Apr 13 15:11:59 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:11:59 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-901e2fde-332f-40c7-8232-df0abbf25ec4 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Returning 404 to user: Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:11:59 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-901e2fde-332f-40c7-8232-df0abbf25ec4 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" status: 404 len: 111 microversion: 2.49 time: 0.030566 Apr 13 15:11:59 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 100/302] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:11:59 2023] GET /compute/v2.1/servers/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:12:11 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:11 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:12:11 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:12:11 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=5 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:12:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:11 user devstack@n-api.service[61871]: DEBUG nova.objects.instance [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'flavor' on Instance uuid f54cffe3-73da-468b-8252-b74cb4ba9653 {{(pid=61871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:12:12 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653/action" status: 200 len: 32 microversion: 2.1 time: 0.142326 Apr 13 15:12:12 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 98/303] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:12:11 2023] POST /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653/action => generated 32 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:12:12 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-118facdb-6cb1-400b-98e0-f05dda0014f5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:12:12 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-118facdb-6cb1-400b-98e0-f05dda0014f5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:12:12 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:12:12 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:12:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-118facdb-6cb1-400b-98e0-f05dda0014f5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-118facdb-6cb1-400b-98e0-f05dda0014f5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-118facdb-6cb1-400b-98e0-f05dda0014f5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-118facdb-6cb1-400b-98e0-f05dda0014f5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-118facdb-6cb1-400b-98e0-f05dda0014f5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-118facdb-6cb1-400b-98e0-f05dda0014f5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:12 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-118facdb-6cb1-400b-98e0-f05dda0014f5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:12:13 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-118facdb-6cb1-400b-98e0-f05dda0014f5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653" status: 200 len: 1508 microversion: 2.1 time: 0.963756 Apr 13 15:12:13 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 106/304] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:12:12 2023] GET /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653 => generated 1508 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:12:13 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-57e8b881-8efe-4e3a-a100-27b912a3e4b7 req-ae7c56b1-2ec7-4bcf-9efd-2e54bb1e44eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f54cffe3-73da-468b-8252-b74cb4ba9653", "name": "network-vif-unplugged", "status": "completed", "tag": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:13 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:12:13 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:12:13 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-57e8b881-8efe-4e3a-a100-27b912a3e4b7 req-ae7c56b1-2ec7-4bcf-9efd-2e54bb1e44eb service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:13 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-57e8b881-8efe-4e3a-a100-27b912a3e4b7 req-ae7c56b1-2ec7-4bcf-9efd-2e54bb1e44eb service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:13 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-57e8b881-8efe-4e3a-a100-27b912a3e4b7 req-ae7c56b1-2ec7-4bcf-9efd-2e54bb1e44eb service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:13 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-57e8b881-8efe-4e3a-a100-27b912a3e4b7 req-ae7c56b1-2ec7-4bcf-9efd-2e54bb1e44eb service nova] Creating event network-vif-unplugged:0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance f54cffe3-73da-468b-8252-b74cb4ba9653 on user Apr 13 15:12:13 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-57e8b881-8efe-4e3a-a100-27b912a3e4b7 req-ae7c56b1-2ec7-4bcf-9efd-2e54bb1e44eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055830 Apr 13 15:12:13 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 101/305] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:15 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f54cffe3-73da-468b-8252-b74cb4ba9653", "name": "network-vif-plugged", "status": "completed", "tag": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d"}, {"server_uuid": "f54cffe3-73da-468b-8252-b74cb4ba9653", "name": "network-vif-plugged", "status": "completed", "tag": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d"}, {"server_uuid": "f54cffe3-73da-468b-8252-b74cb4ba9653", "name": "network-vif-plugged", "status": "completed", "tag": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d"}, {"server_uuid": "f54cffe3-73da-468b-8252-b74cb4ba9653", "name": "network-vif-unplugged", "status": "completed", "tag": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d"}, {"server_uuid": "f54cffe3-73da-468b-8252-b74cb4ba9653", "name": "network-vif-plugged", "status": "completed", "tag": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:15 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Creating event network-vif-plugged:0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance f54cffe3-73da-468b-8252-b74cb4ba9653 on user Apr 13 15:12:15 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Creating event network-vif-plugged:0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance f54cffe3-73da-468b-8252-b74cb4ba9653 on user Apr 13 15:12:15 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Creating event network-vif-plugged:0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance f54cffe3-73da-468b-8252-b74cb4ba9653 on user Apr 13 15:12:15 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Creating event network-vif-unplugged:0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance f54cffe3-73da-468b-8252-b74cb4ba9653 on user Apr 13 15:12:15 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Creating event network-vif-plugged:0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance f54cffe3-73da-468b-8252-b74cb4ba9653 on user Apr 13 15:12:15 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.035108 Apr 13 15:12:15 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 99/306] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:15 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:16 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-eff4d964-851b-41d2-9a68-691c9e8f06cc tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:12:16 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-eff4d964-851b-41d2-9a68-691c9e8f06cc tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:12:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-eff4d964-851b-41d2-9a68-691c9e8f06cc tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-eff4d964-851b-41d2-9a68-691c9e8f06cc tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-eff4d964-851b-41d2-9a68-691c9e8f06cc tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-eff4d964-851b-41d2-9a68-691c9e8f06cc tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-eff4d964-851b-41d2-9a68-691c9e8f06cc tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-eff4d964-851b-41d2-9a68-691c9e8f06cc tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:16 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-eff4d964-851b-41d2-9a68-691c9e8f06cc tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] HTTP exception thrown: Instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd could not be found. Apr 13 15:12:16 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-eff4d964-851b-41d2-9a68-691c9e8f06cc tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Request method failure captured: Apr 13 15:12:16 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd HTTP/1.1 Apr 13 15:12:16 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:12:16 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:12:16 user devstack@n-api.service[61873]: Connection: close Apr 13 15:12:16 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:12:16 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:12:16 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:12:16 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:12:16 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:12:16 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBqquKSFcvbDDA5V6Tj8rHP-aY6BMxrjkXwVSyXiyRVqKI812fz-26F7k9AaR88mvnCXg8jYXfHx5wsG2I-woG9fYZUT5iQKTzIwWCNLylD_RTBS80zv9rEkc-ckXcDO7UCqogjWgC6P44m3imVgVLs417aIeg-ffHlzYqY2ox9CgRk Apr 13 15:12:16 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:12:16 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:12:16 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:12:16 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:12:16 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:12:16 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:12:16 user devstack@n-api.service[61873]: X-Project-Id: 27787b48c024464091785f8308d8733e Apr 13 15:12:16 user devstack@n-api.service[61873]: X-Project-Name: tempest-TestVolumeSwap-927377931 Apr 13 15:12:16 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:12:16 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:12:16 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27787b48c024464091785f8308d8733e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27787b48c024464091785f8308d8733e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27787b48c024464091785f8308d8733e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:12:16 user devstack@n-api.service[61873]: X-Tenant: tempest-TestVolumeSwap-927377931 Apr 13 15:12:16 user devstack@n-api.service[61873]: X-Tenant-Id: 27787b48c024464091785f8308d8733e Apr 13 15:12:16 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-TestVolumeSwap-927377931 Apr 13 15:12:16 user devstack@n-api.service[61873]: X-User: tempest-TestVolumeSwap-927377931-project-member Apr 13 15:12:16 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:12:16 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:12:16 user devstack@n-api.service[61873]: X-User-Id: c2141a10d4f543fdaab261486c7e7221 Apr 13 15:12:16 user devstack@n-api.service[61873]: X-User-Name: tempest-TestVolumeSwap-927377931-project-member Apr 13 15:12:16 user devstack@n-api.service[61873]: method: > Apr 13 15:12:16 user devstack@n-api.service[61873]: exception: Instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd could not be found. Apr 13 15:12:16 user devstack@n-api.service[61873]: action_args: {'id': '193136fc-e6c3-4e70-b7ab-01ced440c6bd'} Apr 13 15:12:16 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd could not be found. Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd could not be found. Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd could not be found. Apr 13 15:12:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:12:16 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-eff4d964-851b-41d2-9a68-691c9e8f06cc tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Returning 404 to user: Instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:12:16 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-eff4d964-851b-41d2-9a68-691c9e8f06cc tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] 10.0.0.210 "GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd" status: 404 len: 111 microversion: 2.1 time: 0.042889 Apr 13 15:12:16 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 107/307] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:12:16 2023] GET /compute/v2.1/servers/193136fc-e6c3-4e70-b7ab-01ced440c6bd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 13 15:12:16 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-abce235b-8fa9-431c-970c-0fb6852cdf53 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Calling method '.version_select at 0x7f3a8fa1da20>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:12:16 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-abce235b-8fa9-431c-970c-0fb6852cdf53 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-207135700" status: 202 len: 0 microversion: 2.1 time: 0.026290 Apr 13 15:12:16 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 102/308] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 15:12:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-207135700 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:12:17 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-d0b95745-b878-4ddb-93ea-c24a8b37f716 req-25cf8da4-96a9-4e4f-b17d-94136629e9ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f54cffe3-73da-468b-8252-b74cb4ba9653", "name": "network-vif-plugged", "status": "completed", "tag": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d"}, {"server_uuid": "f54cffe3-73da-468b-8252-b74cb4ba9653", "name": "network-vif-plugged", "status": "completed", "tag": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-d0b95745-b878-4ddb-93ea-c24a8b37f716 req-25cf8da4-96a9-4e4f-b17d-94136629e9ca service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-d0b95745-b878-4ddb-93ea-c24a8b37f716 req-25cf8da4-96a9-4e4f-b17d-94136629e9ca service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-d0b95745-b878-4ddb-93ea-c24a8b37f716 req-25cf8da4-96a9-4e4f-b17d-94136629e9ca service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:17 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-d0b95745-b878-4ddb-93ea-c24a8b37f716 req-25cf8da4-96a9-4e4f-b17d-94136629e9ca service nova] Creating event network-vif-plugged:0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance f54cffe3-73da-468b-8252-b74cb4ba9653 on user Apr 13 15:12:17 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-d0b95745-b878-4ddb-93ea-c24a8b37f716 req-25cf8da4-96a9-4e4f-b17d-94136629e9ca service nova] Creating event network-vif-plugged:0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance f54cffe3-73da-468b-8252-b74cb4ba9653 on user Apr 13 15:12:17 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-d0b95745-b878-4ddb-93ea-c24a8b37f716 req-25cf8da4-96a9-4e4f-b17d-94136629e9ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037007 Apr 13 15:12:17 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 100/309] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:17 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:23 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-2708c190-61ca-41b9-9f95-6b523ec95bd0 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:12:23 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-2708c190-61ca-41b9-9f95-6b523ec95bd0 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:12:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2708c190-61ca-41b9-9f95-6b523ec95bd0 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2708c190-61ca-41b9-9f95-6b523ec95bd0 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2708c190-61ca-41b9-9f95-6b523ec95bd0 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2708c190-61ca-41b9-9f95-6b523ec95bd0 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2708c190-61ca-41b9-9f95-6b523ec95bd0 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2708c190-61ca-41b9-9f95-6b523ec95bd0 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:23 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-2708c190-61ca-41b9-9f95-6b523ec95bd0 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30a69b780664742aed58bd9a578e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5acb52755c74d118d012e38feed7237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:12:23 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-2708c190-61ca-41b9-9f95-6b523ec95bd0 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818" status: 200 len: 1704 microversion: 2.1 time: 0.227118 Apr 13 15:12:23 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 108/310] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:12:23 2023] GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818 => generated 1704 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:12:24 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:12:24 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "aaed905f-34ee-40a1-9a14-339081983049"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:24 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:12:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:24 user devstack@n-api.service[61872]: DEBUG nova.objects.instance [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'flavor' on Instance uuid 0a0a9548-9e57-4007-bafb-d418a4433473 {{(pid=61872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:12:24 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473/action" status: 200 len: 29 microversion: 2.87 time: 0.801197 Apr 13 15:12:24 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 103/311] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 15:12:24 2023] POST /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473/action => generated 29 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:12:25 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-02320656-37c8-4657-95a5-71283824bd1e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:12:25 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-02320656-37c8-4657-95a5-71283824bd1e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:12:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-02320656-37c8-4657-95a5-71283824bd1e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-02320656-37c8-4657-95a5-71283824bd1e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-02320656-37c8-4657-95a5-71283824bd1e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-02320656-37c8-4657-95a5-71283824bd1e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-02320656-37c8-4657-95a5-71283824bd1e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-02320656-37c8-4657-95a5-71283824bd1e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:25 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-02320656-37c8-4657-95a5-71283824bd1e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:12:25 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-02320656-37c8-4657-95a5-71283824bd1e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:12:25 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-02320656-37c8-4657-95a5-71283824bd1e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:12:25 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-02320656-37c8-4657-95a5-71283824bd1e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473" status: 200 len: 1774 microversion: 2.87 time: 0.357348 Apr 13 15:12:25 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 101/312] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:12:24 2023] GET /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473 => generated 1774 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:12:26 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-c08b3683-be7b-464e-9519-d92cf9d19986 req-ed37889e-6fad-4648-a8c0-4398eff36640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0a9548-9e57-4007-bafb-d418a4433473", "name": "network-vif-unplugged", "status": "completed", "tag": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c08b3683-be7b-464e-9519-d92cf9d19986 req-ed37889e-6fad-4648-a8c0-4398eff36640 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c08b3683-be7b-464e-9519-d92cf9d19986 req-ed37889e-6fad-4648-a8c0-4398eff36640 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c08b3683-be7b-464e-9519-d92cf9d19986 req-ed37889e-6fad-4648-a8c0-4398eff36640 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:26 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-c08b3683-be7b-464e-9519-d92cf9d19986 req-ed37889e-6fad-4648-a8c0-4398eff36640 service nova] Creating event network-vif-unplugged:0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance 0a0a9548-9e57-4007-bafb-d418a4433473 on user Apr 13 15:12:26 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-c08b3683-be7b-464e-9519-d92cf9d19986 req-ed37889e-6fad-4648-a8c0-4398eff36640 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046143 Apr 13 15:12:26 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 109/313] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:28 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-d8023bb6-3f68-46fa-8d57-17ac3821b586 req-a0bf3fad-3a73-4962-8e60-0ef50553d08a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0a9548-9e57-4007-bafb-d418a4433473", "name": "network-vif-plugged", "status": "completed", "tag": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-d8023bb6-3f68-46fa-8d57-17ac3821b586 req-a0bf3fad-3a73-4962-8e60-0ef50553d08a service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-d8023bb6-3f68-46fa-8d57-17ac3821b586 req-a0bf3fad-3a73-4962-8e60-0ef50553d08a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-d8023bb6-3f68-46fa-8d57-17ac3821b586 req-a0bf3fad-3a73-4962-8e60-0ef50553d08a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:28 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-d8023bb6-3f68-46fa-8d57-17ac3821b586 req-a0bf3fad-3a73-4962-8e60-0ef50553d08a service nova] Creating event network-vif-plugged:0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance 0a0a9548-9e57-4007-bafb-d418a4433473 on user Apr 13 15:12:28 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-d8023bb6-3f68-46fa-8d57-17ac3821b586 req-a0bf3fad-3a73-4962-8e60-0ef50553d08a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035837 Apr 13 15:12:28 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 104/314] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:31 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-d2102053-08fc-4fbb-87e4-416dbef5e2e7 req-5cbf27fe-b77f-45a2-a1e0-2f24cbc0bea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0a9548-9e57-4007-bafb-d418a4433473", "name": "network-vif-plugged", "status": "completed", "tag": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-d2102053-08fc-4fbb-87e4-416dbef5e2e7 req-5cbf27fe-b77f-45a2-a1e0-2f24cbc0bea2 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-d2102053-08fc-4fbb-87e4-416dbef5e2e7 req-5cbf27fe-b77f-45a2-a1e0-2f24cbc0bea2 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-d2102053-08fc-4fbb-87e4-416dbef5e2e7 req-5cbf27fe-b77f-45a2-a1e0-2f24cbc0bea2 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:31 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-d2102053-08fc-4fbb-87e4-416dbef5e2e7 req-5cbf27fe-b77f-45a2-a1e0-2f24cbc0bea2 service nova] Creating event network-vif-plugged:0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance 0a0a9548-9e57-4007-bafb-d418a4433473 on user Apr 13 15:12:31 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-d2102053-08fc-4fbb-87e4-416dbef5e2e7 req-5cbf27fe-b77f-45a2-a1e0-2f24cbc0bea2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059410 Apr 13 15:12:31 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 102/315] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:31 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-488073ef-f55b-49d5-80e2-13eec19936d8 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:12:31 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-488073ef-f55b-49d5-80e2-13eec19936d8 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:12:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-488073ef-f55b-49d5-80e2-13eec19936d8 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-488073ef-f55b-49d5-80e2-13eec19936d8 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-488073ef-f55b-49d5-80e2-13eec19936d8 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-488073ef-f55b-49d5-80e2-13eec19936d8 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-488073ef-f55b-49d5-80e2-13eec19936d8 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-488073ef-f55b-49d5-80e2-13eec19936d8 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:32 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-488073ef-f55b-49d5-80e2-13eec19936d8 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:12:32 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-488073ef-f55b-49d5-80e2-13eec19936d8 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1538 microversion: 2.1 time: 0.339842 Apr 13 15:12:32 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 110/316] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:12:31 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1538 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:12:33 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-10f46d71-d395-49db-a894-ba9761398d31 req-8d36c06b-d19b-471d-9a76-687becc19f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0a9548-9e57-4007-bafb-d418a4433473", "name": "network-vif-plugged", "status": "completed", "tag": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-10f46d71-d395-49db-a894-ba9761398d31 req-8d36c06b-d19b-471d-9a76-687becc19f1e service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-10f46d71-d395-49db-a894-ba9761398d31 req-8d36c06b-d19b-471d-9a76-687becc19f1e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-10f46d71-d395-49db-a894-ba9761398d31 req-8d36c06b-d19b-471d-9a76-687becc19f1e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:33 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-10f46d71-d395-49db-a894-ba9761398d31 req-8d36c06b-d19b-471d-9a76-687becc19f1e service nova] Creating event network-vif-plugged:0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance 0a0a9548-9e57-4007-bafb-d418a4433473 on user Apr 13 15:12:33 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-10f46d71-d395-49db-a894-ba9761398d31 req-8d36c06b-d19b-471d-9a76-687becc19f1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029788 Apr 13 15:12:33 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 105/317] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:36 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:36 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:12:36 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:36 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:36 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:36 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:36 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:36 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:36 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61871) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 15:12:36 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] 10.0.0.210 "POST /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211/action" status: 202 len: 0 microversion: 2.1 time: 0.208184 Apr 13 15:12:36 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 103/318] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:12:36 2023] POST /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:12:36 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-1f87d569-bad4-456e-9a9b-6ba48c32aedc tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:12:36 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-1f87d569-bad4-456e-9a9b-6ba48c32aedc tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:12:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1f87d569-bad4-456e-9a9b-6ba48c32aedc tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1f87d569-bad4-456e-9a9b-6ba48c32aedc tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1f87d569-bad4-456e-9a9b-6ba48c32aedc tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1f87d569-bad4-456e-9a9b-6ba48c32aedc tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1f87d569-bad4-456e-9a9b-6ba48c32aedc tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1f87d569-bad4-456e-9a9b-6ba48c32aedc tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:37 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-1f87d569-bad4-456e-9a9b-6ba48c32aedc tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc0cce3df7540078438186f46ca4621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7227559570b54e92be19d25938523b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:12:37 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-1f87d569-bad4-456e-9a9b-6ba48c32aedc tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211" status: 200 len: 1507 microversion: 2.1 time: 0.346573 Apr 13 15:12:37 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 111/319] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:12:36 2023] GET /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211 => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:12:38 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-7472d674-2a39-490a-bddb-7b714c385754 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Action: 'create', calling method: .version_select at 0x7f3a8fa5d360>, body: {"keypair": {"name": "tempest-keypair-251315304", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg=="}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:38 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-7472d674-2a39-490a-bddb-7b714c385754 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Getting quotas for project ac94a736e99f4f978f043f2b1b929284. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:12:38 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-7472d674-2a39-490a-bddb-7b714c385754 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Getting quotas for user 9dc549309fa74c0a8eb2f44e5959ce92 and project ac94a736e99f4f978f043f2b1b929284. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:12:38 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-7472d674-2a39-490a-bddb-7b714c385754 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.063008 Apr 13 15:12:38 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 106/320] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 15:12:38 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 15:12:40 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-16eb283c-9932-4437-ae8a-51a8166bc61c tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Action: 'create', calling method: .version_select at 0x7f3a8fbf2b00>, body: {"keypair": {"name": "tempest-keypair-668401822", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2SLcMiFgeCGm8qDvk239BUNYX+UtVog7KDE/ZD3+2Ret07WDLkvqlCUEuqEVQhO7R4vu2xqjummEPXt2P2UbONLsP1RXtpmEWZvzafPSVJn4Tv2i6p0heMGqPGdn6X6w=="}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:40 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-16eb283c-9932-4437-ae8a-51a8166bc61c tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Getting quotas for project ceba33821a9b4f7aa81c2857c11261f1. Resources: {'key_pairs'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:12:40 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-16eb283c-9932-4437-ae8a-51a8166bc61c tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Getting quotas for user de1a698b103a47c0b2864eef54be648b and project ceba33821a9b4f7aa81c2857c11261f1. Resources: {'key_pairs'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:12:40 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-16eb283c-9932-4437-ae8a-51a8166bc61c tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102908 Apr 13 15:12:40 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 104/321] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 15:12:40 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:40 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-286688180", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "c6073972-8aae-444d-95f2-fbc4e4a63d06"}, {"port": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "tag": "port-1"}, {"port": "26419cbf-54b6-47ab-a068-356727e4a6ca", "tag": "port-2"}, {"uuid": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "tag": "net-1"}, {"uuid": "86a8c3fe-5a23-4245-aa67-ac25b3164369"}, {"uuid": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "15da0023-8e48-431d-a2f0-2813a183bc2b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "66aa0088-0ff5-4f9a-ad2c-5917811cd32b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "81beedc0-0e22-4d24-9f34-375b2890a9f8", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--860995184"}], "key_name": "tempest-keypair-251315304", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:40 user devstack@n-api.service[61873]: DEBUG nova.network.neutron [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] validate_networks() for [('c6073972-8aae-444d-95f2-fbc4e4a63d06', None, None, None, None, None), (None, None, '458d18a0-cd93-4e5f-8d97-842f7d0dc73d', None, None, None), (None, None, '26419cbf-54b6-47ab-a068-356727e4a6ca', None, None, None), ('86a8c3fe-5a23-4245-aa67-ac25b3164369', None, None, None, None, None), ('86a8c3fe-5a23-4245-aa67-ac25b3164369', None, None, None, None, None), ('96e744af-ef9d-42cf-ac74-b64e75ccbaee', '10.2.2.100', None, None, None, None), ('96e744af-ef9d-42cf-ac74-b64e75ccbaee', '10.2.2.200', None, None, None, None)] {{(pid=61873) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:12:40 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:12:40 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:12:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:41 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Going to try to terminate instance {{(pid=61872) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:12:41 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1c9a3524-caeb-4333-ae2b-1080115026fd" status: 204 len: 0 microversion: 2.1 time: 0.120967 Apr 13 15:12:41 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 107/322] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:12:40 2023] DELETE /compute/v2.1/servers/1c9a3524-caeb-4333-ae2b-1080115026fd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:12:41 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-ebf4258b-37f1-4363-a029-239ededceee3 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:12:41 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-ebf4258b-37f1-4363-a029-239ededceee3 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:12:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ebf4258b-37f1-4363-a029-239ededceee3 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ebf4258b-37f1-4363-a029-239ededceee3 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ebf4258b-37f1-4363-a029-239ededceee3 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ebf4258b-37f1-4363-a029-239ededceee3 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ebf4258b-37f1-4363-a029-239ededceee3 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ebf4258b-37f1-4363-a029-239ededceee3 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:41 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-ebf4258b-37f1-4363-a029-239ededceee3 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc942f33ca46c08bb143ed2efeb458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0cae04ab4b4157a7ef786d165789a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:12:41 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-ebf4258b-37f1-4363-a029-239ededceee3 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c9a3524-caeb-4333-ae2b-1080115026fd" status: 200 len: 1492 microversion: 2.1 time: 0.412560 Apr 13 15:12:41 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 105/323] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:12:41 2023] GET /compute/v2.1/servers/1c9a3524-caeb-4333-ae2b-1080115026fd => generated 1492 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:12:41 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-2c45cb26-9e5e-488d-b4b3-50b7902a09b8 req-9a1b1a5b-888e-4fe0-9863-5f8b8080e54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c9a3524-caeb-4333-ae2b-1080115026fd", "name": "network-vif-unplugged", "status": "completed", "tag": "575668b5-eb5b-4275-962a-db577c3931a0"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:41 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-2c45cb26-9e5e-488d-b4b3-50b7902a09b8 req-9a1b1a5b-888e-4fe0-9863-5f8b8080e54b service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:41 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-2c45cb26-9e5e-488d-b4b3-50b7902a09b8 req-9a1b1a5b-888e-4fe0-9863-5f8b8080e54b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:41 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-2c45cb26-9e5e-488d-b4b3-50b7902a09b8 req-9a1b1a5b-888e-4fe0-9863-5f8b8080e54b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:41 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-2c45cb26-9e5e-488d-b4b3-50b7902a09b8 req-9a1b1a5b-888e-4fe0-9863-5f8b8080e54b service nova] Creating event network-vif-unplugged:575668b5-eb5b-4275-962a-db577c3931a0 for instance 1c9a3524-caeb-4333-ae2b-1080115026fd on user Apr 13 15:12:41 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-2c45cb26-9e5e-488d-b4b3-50b7902a09b8 req-9a1b1a5b-888e-4fe0-9863-5f8b8080e54b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114415 Apr 13 15:12:41 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 108/324] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:42 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1504684221", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "9e196c6b-274c-477b-9f83-c526ca47c2a0"}], "security_groups": [{"name": "tempest-securitygroup--89769090"}], "key_name": "tempest-keypair-668401822", "user_data": "}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:42 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:12:42 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-e0daaa22-ad61-41ae-89d5-e03dddb0bdf5 req-aa038464-c806-4987-a342-bc5290ec9333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c9a3524-caeb-4333-ae2b-1080115026fd", "name": "network-vif-deleted", "tag": "575668b5-eb5b-4275-962a-db577c3931a0"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:42 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-e0daaa22-ad61-41ae-89d5-e03dddb0bdf5 req-aa038464-c806-4987-a342-bc5290ec9333 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:42 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-e0daaa22-ad61-41ae-89d5-e03dddb0bdf5 req-aa038464-c806-4987-a342-bc5290ec9333 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:42 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-e0daaa22-ad61-41ae-89d5-e03dddb0bdf5 req-aa038464-c806-4987-a342-bc5290ec9333 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:42 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-e0daaa22-ad61-41ae-89d5-e03dddb0bdf5 req-aa038464-c806-4987-a342-bc5290ec9333 service nova] Creating event network-vif-deleted:575668b5-eb5b-4275-962a-db577c3931a0 for instance 1c9a3524-caeb-4333-ae2b-1080115026fd on user Apr 13 15:12:42 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-e0daaa22-ad61-41ae-89d5-e03dddb0bdf5 req-aa038464-c806-4987-a342-bc5290ec9333 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090984 Apr 13 15:12:42 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 109/325] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:12:42 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] validate_networks() for [('9e196c6b-274c-477b-9f83-c526ca47c2a0', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:12:43 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Flavor limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:12:43 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Image limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:12:43 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Flavor pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:12:43 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Image pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:12:43 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:43 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=17 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:12:43 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:43 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:43 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:43 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:43 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:43 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:43 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=29 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Getting quotas for project ceba33821a9b4f7aa81c2857c11261f1. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Getting quotas for user de1a698b103a47c0b2864eef54be648b and project ceba33821a9b4f7aa81c2857c11261f1. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:12:43 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Getting quotas for project ac94a736e99f4f978f043f2b1b929284. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:12:43 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Getting quotas for user 9dc549309fa74c0a8eb2f44e5959ce92 and project ac94a736e99f4f978f043f2b1b929284. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:12:43 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.1 time: 1.102102 Apr 13 15:12:43 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 106/326] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:12:42 2023] POST /compute/v2.1/servers => generated 398 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:12:43 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-947eea91-3b74-41d7-b6d1-5f49f6c64529 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:12:43 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-947eea91-3b74-41d7-b6d1-5f49f6c64529 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:12:43 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-5868c73c-6587-497d-a8b3-fdd01462068f req-9c1deaf3-11ef-479d-8216-2ce35bdece29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c9a3524-caeb-4333-ae2b-1080115026fd", "name": "network-vif-plugged", "status": "completed", "tag": "575668b5-eb5b-4275-962a-db577c3931a0"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-5868c73c-6587-497d-a8b3-fdd01462068f req-9c1deaf3-11ef-479d-8216-2ce35bdece29 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-5868c73c-6587-497d-a8b3-fdd01462068f req-9c1deaf3-11ef-479d-8216-2ce35bdece29 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:43 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-5868c73c-6587-497d-a8b3-fdd01462068f req-9c1deaf3-11ef-479d-8216-2ce35bdece29 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:43 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-5868c73c-6587-497d-a8b3-fdd01462068f req-9c1deaf3-11ef-479d-8216-2ce35bdece29 service nova] Creating event network-vif-plugged:575668b5-eb5b-4275-962a-db577c3931a0 for instance 1c9a3524-caeb-4333-ae2b-1080115026fd on user Apr 13 15:12:43 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-947eea91-3b74-41d7-b6d1-5f49f6c64529 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1a698b103a47c0b2864eef54be648b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceba33821a9b4f7aa81c2857c11261f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:12:43 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-5868c73c-6587-497d-a8b3-fdd01462068f req-9c1deaf3-11ef-479d-8216-2ce35bdece29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043141 Apr 13 15:12:43 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 107/327] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:43 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-947eea91-3b74-41d7-b6d1-5f49f6c64529 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3" status: 200 len: 1231 microversion: 2.1 time: 0.071371 Apr 13 15:12:43 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 110/328] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:12:43 2023] GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3 => generated 1231 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:12:43 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Going to run 1 instances... {{(pid=61873) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:12:43 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='15da0023-8e48-431d-a2f0-2813a183bc2b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='66aa0088-0ff5-4f9a-ad2c-5917811cd32b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='81beedc0-0e22-4d24-9f34-375b2890a9f8',volume_size=None,volume_type=None)] {{(pid=61873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:12:44 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.42 time: 3.598808 Apr 13 15:12:44 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 112/329] 10.0.0.210 () {66 vars in 1266 bytes} [Thu Apr 13 15:12:40 2023] POST /compute/v2.1/servers => generated 403 bytes in 3601 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 15:12:44 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c8aaf0c1-357a-40dc-9613-a1f944cfe439 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:12:44 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-c8aaf0c1-357a-40dc-9613-a1f944cfe439 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:12:44 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-c8aaf0c1-357a-40dc-9613-a1f944cfe439 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc549309fa74c0a8eb2f44e5959ce92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac94a736e99f4f978f043f2b1b929284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:12:44 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-c8aaf0c1-357a-40dc-9613-a1f944cfe439 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dc549309fa74c0a8eb2f44e5959ce92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac94a736e99f4f978f043f2b1b929284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:12:44 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-c8aaf0c1-357a-40dc-9613-a1f944cfe439 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dc549309fa74c0a8eb2f44e5959ce92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac94a736e99f4f978f043f2b1b929284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:12:44 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-c8aaf0c1-357a-40dc-9613-a1f944cfe439 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350" status: 200 len: 1278 microversion: 2.42 time: 0.085852 Apr 13 15:12:44 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 108/330] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:12:44 2023] GET /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350 => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 13 15:12:44 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-82d9cd8c-b812-4c79-8c26-b3d337b10dc3 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d9102aee-523c-4cd4-9040-6042d339329e"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:44 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-82d9cd8c-b812-4c79-8c26-b3d337b10dc3 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:12:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-82d9cd8c-b812-4c79-8c26-b3d337b10dc3 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-82d9cd8c-b812-4c79-8c26-b3d337b10dc3 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-82d9cd8c-b812-4c79-8c26-b3d337b10dc3 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-82d9cd8c-b812-4c79-8c26-b3d337b10dc3 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-82d9cd8c-b812-4c79-8c26-b3d337b10dc3 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-82d9cd8c-b812-4c79-8c26-b3d337b10dc3 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:44 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-82d9cd8c-b812-4c79-8c26-b3d337b10dc3 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] HTTP exception thrown: Volume 6d07b3f4-bd77-44fa-97b9-09c64c3b1c53 could not be found. Apr 13 15:12:44 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-82d9cd8c-b812-4c79-8c26-b3d337b10dc3 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] Request method failure captured: Apr 13 15:12:44 user devstack@n-api.service[61872]: request: PUT /compute/v2.1/servers/bfc41492-c482-4a9f-8a5b-9d7520dea39a/os-volume_attachments/6d07b3f4-bd77-44fa-97b9-09c64c3b1c53 HTTP/1.1 Apr 13 15:12:44 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:12:44 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:12:44 user devstack@n-api.service[61872]: Connection: close Apr 13 15:12:44 user devstack@n-api.service[61872]: Content-Length: 74 Apr 13 15:12:44 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:12:44 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:12:44 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:12:44 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:12:44 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBrHAEPd9nB5JKkh9hv2LaFtaX8UqZb_a-lsoyz8_BlTYTgYVzy5zN0V63mlrhIQOmy8Xx1EioaJLpHrbiy7i7bckNnjx_tM3kmfvM0PN3G9BSTk4u8UF_r-pwevr698hxeMEn8EzefB6y-Y4VVhFRAoiA8pVQP0dLTKdOS6-VBOf5w Apr 13 15:12:44 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:12:44 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:12:44 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:12:44 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:12:44 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:12:44 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:12:44 user devstack@n-api.service[61872]: X-Project-Id: e00d15c7e1664a65958927d90ea1596c Apr 13 15:12:44 user devstack@n-api.service[61872]: X-Project-Name: tempest-VolumesAdminNegativeTest-160555478 Apr 13 15:12:44 user devstack@n-api.service[61872]: X-Role: member,reader,admin Apr 13 15:12:44 user devstack@n-api.service[61872]: X-Roles: member,reader,admin Apr 13 15:12:44 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e00d15c7e1664a65958927d90ea1596c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e00d15c7e1664a65958927d90ea1596c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e00d15c7e1664a65958927d90ea1596c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:12:44 user devstack@n-api.service[61872]: X-Tenant: tempest-VolumesAdminNegativeTest-160555478 Apr 13 15:12:44 user devstack@n-api.service[61872]: X-Tenant-Id: e00d15c7e1664a65958927d90ea1596c Apr 13 15:12:44 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-160555478 Apr 13 15:12:44 user devstack@n-api.service[61872]: X-User: tempest-VolumesAdminNegativeTest-160555478-project-admin Apr 13 15:12:44 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:12:44 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:12:44 user devstack@n-api.service[61872]: X-User-Id: 526e3daaeed7478cab39f71f3b7ac055 Apr 13 15:12:44 user devstack@n-api.service[61872]: X-User-Name: tempest-VolumesAdminNegativeTest-160555478-project-admin Apr 13 15:12:44 user devstack@n-api.service[61872]: Apr 13 15:12:44 user devstack@n-api.service[61872]: {"volumeAttachment": {"volumeId": "d9102aee-523c-4cd4-9040-6042d339329e"}} Apr 13 15:12:44 user devstack@n-api.service[61872]: method: > Apr 13 15:12:44 user devstack@n-api.service[61872]: exception: Volume 6d07b3f4-bd77-44fa-97b9-09c64c3b1c53 could not be found. Apr 13 15:12:44 user devstack@n-api.service[61872]: action_args: {'server_id': 'bfc41492-c482-4a9f-8a5b-9d7520dea39a', 'id': '6d07b3f4-bd77-44fa-97b9-09c64c3b1c53', 'body': {'volumeAttachment': {'volumeId': 'd9102aee-523c-4cd4-9040-6042d339329e'}}} Apr 13 15:12:44 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6d07b3f4-bd77-44fa-97b9-09c64c3b1c53 could not be found. (HTTP 404) (Request-ID: req-06917162-ccbc-4714-8fa8-ad6585992bf5) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6d07b3f4-bd77-44fa-97b9-09c64c3b1c53 could not be found. Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6d07b3f4-bd77-44fa-97b9-09c64c3b1c53 could not be found. Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6d07b3f4-bd77-44fa-97b9-09c64c3b1c53 could not be found. Apr 13 15:12:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:12:44 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-82d9cd8c-b812-4c79-8c26-b3d337b10dc3 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] Returning 404 to user: Volume 6d07b3f4-bd77-44fa-97b9-09c64c3b1c53 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:12:44 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-82d9cd8c-b812-4c79-8c26-b3d337b10dc3 tempest-VolumesAdminNegativeTest-160555478 tempest-VolumesAdminNegativeTest-160555478-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/bfc41492-c482-4a9f-8a5b-9d7520dea39a/os-volume_attachments/6d07b3f4-bd77-44fa-97b9-09c64c3b1c53" status: 404 len: 109 microversion: 2.1 time: 0.078813 Apr 13 15:12:44 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 111/331] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 15:12:44 2023] PUT /compute/v2.1/servers/bfc41492-c482-4a9f-8a5b-9d7520dea39a/os-volume_attachments/6d07b3f4-bd77-44fa-97b9-09c64c3b1c53 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:12:45 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-b89f4e25-c114-4d14-bb36-8cb7daa55fc1 req-72b04b41-7191-48fd-adcd-b6d5cc44f8fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179b6945-589d-402c-a89e-6b8d68725211", "tag": "b6a42460-29f0-496d-a7ba-d7ae2259f317"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b89f4e25-c114-4d14-bb36-8cb7daa55fc1 req-72b04b41-7191-48fd-adcd-b6d5cc44f8fe service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b89f4e25-c114-4d14-bb36-8cb7daa55fc1 req-72b04b41-7191-48fd-adcd-b6d5cc44f8fe service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b89f4e25-c114-4d14-bb36-8cb7daa55fc1 req-72b04b41-7191-48fd-adcd-b6d5cc44f8fe service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:45 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-b89f4e25-c114-4d14-bb36-8cb7daa55fc1 req-72b04b41-7191-48fd-adcd-b6d5cc44f8fe service nova] Creating event network-changed:b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance 179b6945-589d-402c-a89e-6b8d68725211 on user Apr 13 15:12:45 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-b89f4e25-c114-4d14-bb36-8cb7daa55fc1 req-72b04b41-7191-48fd-adcd-b6d5cc44f8fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029285 Apr 13 15:12:45 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 113/332] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:46 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:12:46 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:12:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:46 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Going to try to terminate instance {{(pid=61871) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:12:46 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bfc41492-c482-4a9f-8a5b-9d7520dea39a" status: 204 len: 0 microversion: 2.1 time: 0.127943 Apr 13 15:12:46 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 109/333] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:12:46 2023] DELETE /compute/v2.1/servers/bfc41492-c482-4a9f-8a5b-9d7520dea39a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:12:46 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-99c5808e-4502-438d-8702-77b78a20bfa9 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:12:46 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-99c5808e-4502-438d-8702-77b78a20bfa9 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:12:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-99c5808e-4502-438d-8702-77b78a20bfa9 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-99c5808e-4502-438d-8702-77b78a20bfa9 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-99c5808e-4502-438d-8702-77b78a20bfa9 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-99c5808e-4502-438d-8702-77b78a20bfa9 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-99c5808e-4502-438d-8702-77b78a20bfa9 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-99c5808e-4502-438d-8702-77b78a20bfa9 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:47 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-99c5808e-4502-438d-8702-77b78a20bfa9 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b07929cf2c404ab10ce944437e9e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7b81912360422a8413f8760b0cf7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:12:47 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-99c5808e-4502-438d-8702-77b78a20bfa9 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfc41492-c482-4a9f-8a5b-9d7520dea39a" status: 200 len: 1501 microversion: 2.1 time: 0.389260 Apr 13 15:12:47 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 112/334] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:12:46 2023] GET /compute/v2.1/servers/bfc41492-c482-4a9f-8a5b-9d7520dea39a => generated 1501 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 15:12:47 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-61f488a5-6948-490d-9818-4c9e15818225 req-49dbe906-fd7b-4181-8aea-1ab41a57ddc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc41492-c482-4a9f-8a5b-9d7520dea39a", "name": "network-vif-unplugged", "status": "completed", "tag": "4251e566-faf6-4d5a-a5be-048443db64db"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-61f488a5-6948-490d-9818-4c9e15818225 req-49dbe906-fd7b-4181-8aea-1ab41a57ddc8 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-61f488a5-6948-490d-9818-4c9e15818225 req-49dbe906-fd7b-4181-8aea-1ab41a57ddc8 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-61f488a5-6948-490d-9818-4c9e15818225 req-49dbe906-fd7b-4181-8aea-1ab41a57ddc8 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:47 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-61f488a5-6948-490d-9818-4c9e15818225 req-49dbe906-fd7b-4181-8aea-1ab41a57ddc8 service nova] Creating event network-vif-unplugged:4251e566-faf6-4d5a-a5be-048443db64db for instance bfc41492-c482-4a9f-8a5b-9d7520dea39a on user Apr 13 15:12:47 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-61f488a5-6948-490d-9818-4c9e15818225 req-49dbe906-fd7b-4181-8aea-1ab41a57ddc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.182571 Apr 13 15:12:47 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 114/335] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:47 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-d23e8ff7-561d-467d-a445-2823f129d9ca req-cd99ec4c-5971-4efd-8442-fa45095977ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa74d14-db6f-41f5-b8af-32da312209d3", "tag": "84611f06-d6ca-49e1-afe7-7723921e62dc"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:47 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-d23e8ff7-561d-467d-a445-2823f129d9ca req-cd99ec4c-5971-4efd-8442-fa45095977ec service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:47 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-d23e8ff7-561d-467d-a445-2823f129d9ca req-cd99ec4c-5971-4efd-8442-fa45095977ec service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:47 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-d23e8ff7-561d-467d-a445-2823f129d9ca req-cd99ec4c-5971-4efd-8442-fa45095977ec service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:47 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-d23e8ff7-561d-467d-a445-2823f129d9ca req-cd99ec4c-5971-4efd-8442-fa45095977ec service nova] Creating event network-changed:84611f06-d6ca-49e1-afe7-7723921e62dc for instance 1aa74d14-db6f-41f5-b8af-32da312209d3 on user Apr 13 15:12:47 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-d23e8ff7-561d-467d-a445-2823f129d9ca req-cd99ec4c-5971-4efd-8442-fa45095977ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078412 Apr 13 15:12:47 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 110/336] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:49 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-d8e370fb-629c-4bcc-8c23-743b82f9e4ee req-b29d9ac4-f95b-43f4-b9a2-e57ddf5522ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179b6945-589d-402c-a89e-6b8d68725211", "name": "network-vif-plugged", "status": "completed", "tag": "b6a42460-29f0-496d-a7ba-d7ae2259f317"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-d8e370fb-629c-4bcc-8c23-743b82f9e4ee req-b29d9ac4-f95b-43f4-b9a2-e57ddf5522ce service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-d8e370fb-629c-4bcc-8c23-743b82f9e4ee req-b29d9ac4-f95b-43f4-b9a2-e57ddf5522ce service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-d8e370fb-629c-4bcc-8c23-743b82f9e4ee req-b29d9ac4-f95b-43f4-b9a2-e57ddf5522ce service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:49 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-d8e370fb-629c-4bcc-8c23-743b82f9e4ee req-b29d9ac4-f95b-43f4-b9a2-e57ddf5522ce service nova] Creating event network-vif-plugged:b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance 179b6945-589d-402c-a89e-6b8d68725211 on user Apr 13 15:12:49 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-d8e370fb-629c-4bcc-8c23-743b82f9e4ee req-b29d9ac4-f95b-43f4-b9a2-e57ddf5522ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041082 Apr 13 15:12:49 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 113/337] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:49 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-b49a177e-20ae-4661-b2c9-19399ab6297f req-8153d507-b643-4e89-98d3-0ae1f969afa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc41492-c482-4a9f-8a5b-9d7520dea39a", "name": "network-vif-plugged", "status": "completed", "tag": "4251e566-faf6-4d5a-a5be-048443db64db"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b49a177e-20ae-4661-b2c9-19399ab6297f req-8153d507-b643-4e89-98d3-0ae1f969afa8 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b49a177e-20ae-4661-b2c9-19399ab6297f req-8153d507-b643-4e89-98d3-0ae1f969afa8 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b49a177e-20ae-4661-b2c9-19399ab6297f req-8153d507-b643-4e89-98d3-0ae1f969afa8 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:49 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-b49a177e-20ae-4661-b2c9-19399ab6297f req-8153d507-b643-4e89-98d3-0ae1f969afa8 service nova] Creating event network-vif-plugged:4251e566-faf6-4d5a-a5be-048443db64db for instance bfc41492-c482-4a9f-8a5b-9d7520dea39a on user Apr 13 15:12:49 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-b49a177e-20ae-4661-b2c9-19399ab6297f req-8153d507-b643-4e89-98d3-0ae1f969afa8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032124 Apr 13 15:12:49 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 115/338] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:49 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-9bb210cf-4f13-4081-a5d6-5cf8c3cdbbe0 req-13ba5ae8-5b95-4923-9ddf-951d3b417424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc41492-c482-4a9f-8a5b-9d7520dea39a", "name": "network-vif-deleted", "tag": "4251e566-faf6-4d5a-a5be-048443db64db"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-9bb210cf-4f13-4081-a5d6-5cf8c3cdbbe0 req-13ba5ae8-5b95-4923-9ddf-951d3b417424 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-9bb210cf-4f13-4081-a5d6-5cf8c3cdbbe0 req-13ba5ae8-5b95-4923-9ddf-951d3b417424 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-9bb210cf-4f13-4081-a5d6-5cf8c3cdbbe0 req-13ba5ae8-5b95-4923-9ddf-951d3b417424 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:49 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-9bb210cf-4f13-4081-a5d6-5cf8c3cdbbe0 req-13ba5ae8-5b95-4923-9ddf-951d3b417424 service nova] Creating event network-vif-deleted:4251e566-faf6-4d5a-a5be-048443db64db for instance bfc41492-c482-4a9f-8a5b-9d7520dea39a on user Apr 13 15:12:49 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-9bb210cf-4f13-4081-a5d6-5cf8c3cdbbe0 req-13ba5ae8-5b95-4923-9ddf-951d3b417424 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039026 Apr 13 15:12:49 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 111/339] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:51 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-105844ae-966b-4569-9bd1-3edb1d84c025 req-cf6670e9-39f4-4072-a6e9-35945da1cc9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179b6945-589d-402c-a89e-6b8d68725211", "name": "network-vif-plugged", "status": "completed", "tag": "b6a42460-29f0-496d-a7ba-d7ae2259f317"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:51 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-105844ae-966b-4569-9bd1-3edb1d84c025 req-cf6670e9-39f4-4072-a6e9-35945da1cc9c service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:51 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-105844ae-966b-4569-9bd1-3edb1d84c025 req-cf6670e9-39f4-4072-a6e9-35945da1cc9c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:51 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-105844ae-966b-4569-9bd1-3edb1d84c025 req-cf6670e9-39f4-4072-a6e9-35945da1cc9c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:51 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-105844ae-966b-4569-9bd1-3edb1d84c025 req-cf6670e9-39f4-4072-a6e9-35945da1cc9c service nova] Creating event network-vif-plugged:b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance 179b6945-589d-402c-a89e-6b8d68725211 on user Apr 13 15:12:51 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-105844ae-966b-4569-9bd1-3edb1d84c025 req-cf6670e9-39f4-4072-a6e9-35945da1cc9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043198 Apr 13 15:12:51 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 114/340] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:51 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-0fa3f75b-ffc6-4fdb-a692-5e45e11f8845 req-40cc4ff4-27d3-4a0e-827b-d433ca9d8688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa74d14-db6f-41f5-b8af-32da312209d3", "name": "network-vif-plugged", "status": "completed", "tag": "84611f06-d6ca-49e1-afe7-7723921e62dc"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-0fa3f75b-ffc6-4fdb-a692-5e45e11f8845 req-40cc4ff4-27d3-4a0e-827b-d433ca9d8688 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-0fa3f75b-ffc6-4fdb-a692-5e45e11f8845 req-40cc4ff4-27d3-4a0e-827b-d433ca9d8688 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-0fa3f75b-ffc6-4fdb-a692-5e45e11f8845 req-40cc4ff4-27d3-4a0e-827b-d433ca9d8688 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:51 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-0fa3f75b-ffc6-4fdb-a692-5e45e11f8845 req-40cc4ff4-27d3-4a0e-827b-d433ca9d8688 service nova] Creating event network-vif-plugged:84611f06-d6ca-49e1-afe7-7723921e62dc for instance 1aa74d14-db6f-41f5-b8af-32da312209d3 on user Apr 13 15:12:51 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-0fa3f75b-ffc6-4fdb-a692-5e45e11f8845 req-40cc4ff4-27d3-4a0e-827b-d433ca9d8688 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048074 Apr 13 15:12:51 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 116/341] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:53 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:12:53 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "tag": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1"}, {"server_uuid": "1aa74d14-db6f-41f5-b8af-32da312209d3", "name": "network-vif-plugged", "status": "completed", "tag": "84611f06-d6ca-49e1-afe7-7723921e62dc"}, {"name": "network-changed", "server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "tag": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d"}, {"name": "network-changed", "server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "tag": "26419cbf-54b6-47ab-a068-356727e4a6ca"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:53 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Creating event network-changed:5eac5fa3-8589-47e1-8c93-bb65b7b095a1 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:12:53 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Creating event network-vif-plugged:84611f06-d6ca-49e1-afe7-7723921e62dc for instance 1aa74d14-db6f-41f5-b8af-32da312209d3 on user Apr 13 15:12:53 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Creating event network-changed:458d18a0-cd93-4e5f-8d97-842f7d0dc73d for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:12:53 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Creating event network-changed:26419cbf-54b6-47ab-a068-356727e4a6ca for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:12:53 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 684 microversion: 2.1 time: 0.039398 Apr 13 15:12:53 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 112/342] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:53 2023] POST /compute/v2.1/os-server-external-events => generated 684 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:55 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:12:55 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "tag": "b572fcf6-8374-49f4-b760-dc845d794668"}, {"name": "network-changed", "server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "tag": "dda3844e-0bda-47ff-8de6-25b9cde47976"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:55 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:12:56 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] Creating event network-changed:b572fcf6-8374-49f4-b760-dc845d794668 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:12:56 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] Creating event network-changed:dda3844e-0bda-47ff-8de6-25b9cde47976 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:12:56 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.070577 Apr 13 15:12:56 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 115/343] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:55 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:58 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:12:58 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:12:58 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "tag": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2"}, {"name": "network-changed", "server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "tag": "0f04a8c8-b74c-4ecf-9a72-0628b196102c"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:12:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:58 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] Creating event network-changed:c6f28318-b210-4a1d-8954-d7e8dc4b19e2 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:12:58 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] Creating event network-changed:0f04a8c8-b74c-4ecf-9a72-0628b196102c for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:12:58 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046568 Apr 13 15:12:58 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 117/344] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:12:58 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:58 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=12 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:12:58 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-bb641af2-1ba4-4ed1-83a2-83f1b3a38dbc tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:12:58 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-bb641af2-1ba4-4ed1-83a2-83f1b3a38dbc tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:12:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-bb641af2-1ba4-4ed1-83a2-83f1b3a38dbc tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-bb641af2-1ba4-4ed1-83a2-83f1b3a38dbc tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-bb641af2-1ba4-4ed1-83a2-83f1b3a38dbc tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-bb641af2-1ba4-4ed1-83a2-83f1b3a38dbc tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-bb641af2-1ba4-4ed1-83a2-83f1b3a38dbc tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-bb641af2-1ba4-4ed1-83a2-83f1b3a38dbc tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:58 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-bb641af2-1ba4-4ed1-83a2-83f1b3a38dbc tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:12:58 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-bb641af2-1ba4-4ed1-83a2-83f1b3a38dbc tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" status: 200 len: 1535 microversion: 2.1 time: 0.170880 Apr 13 15:12:58 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 113/345] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:12:58 2023] GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff => generated 1535 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:12:58 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-1ecd7d1a-9dc1-4560-add0-51d61e561fa9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:12:58 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-1ecd7d1a-9dc1-4560-add0-51d61e561fa9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:12:58 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-1ecd7d1a-9dc1-4560-add0-51d61e561fa9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Searching by: {'deleted': False, 'project_id': '738150b0ec0c4ce887397f161c7e8c21'} {{(pid=61872) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 13 15:12:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-1ecd7d1a-9dc1-4560-add0-51d61e561fa9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-1ecd7d1a-9dc1-4560-add0-51d61e561fa9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-1ecd7d1a-9dc1-4560-add0-51d61e561fa9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-1ecd7d1a-9dc1-4560-add0-51d61e561fa9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-1ecd7d1a-9dc1-4560-add0-51d61e561fa9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-1ecd7d1a-9dc1-4560-add0-51d61e561fa9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:58 user devstack@n-api.service[61872]: DEBUG nova.compute.multi_cell_list [None req-1ecd7d1a-9dc1-4560-add0-51d61e561fa9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 13 15:12:58 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-1ecd7d1a-9dc1-4560-add0-51d61e561fa9 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.219742 Apr 13 15:12:58 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 116/346] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 13 15:12:58 2023] GET /compute/v2.1/servers => generated 340 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:12:58 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-1e846633-1669-4c0b-897e-47743bd581d0 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:12:58 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-1e846633-1669-4c0b-897e-47743bd581d0 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:12:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1e846633-1669-4c0b-897e-47743bd581d0 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1e846633-1669-4c0b-897e-47743bd581d0 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1e846633-1669-4c0b-897e-47743bd581d0 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1e846633-1669-4c0b-897e-47743bd581d0 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:12:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1e846633-1669-4c0b-897e-47743bd581d0 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:12:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1e846633-1669-4c0b-897e-47743bd581d0 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:12:58 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-1e846633-1669-4c0b-897e-47743bd581d0 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:12:58 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-1e846633-1669-4c0b-897e-47743bd581d0 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" status: 200 len: 1535 microversion: 2.1 time: 0.180698 Apr 13 15:12:58 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 118/347] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:12:58 2023] GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff => generated 1535 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:13:00 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f29176ab-5dde-4b23-9e8d-4aee8409dcb0"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:00 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:00 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "POST /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304412 Apr 13 15:13:00 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 114/348] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:13:00 2023] POST /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:03 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-78f8cb94-e3af-4b69-8d79-0eb29893ccc9 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:13:03 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-78f8cb94-e3af-4b69-8d79-0eb29893ccc9 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-78f8cb94-e3af-4b69-8d79-0eb29893ccc9 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-78f8cb94-e3af-4b69-8d79-0eb29893ccc9 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-78f8cb94-e3af-4b69-8d79-0eb29893ccc9 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-78f8cb94-e3af-4b69-8d79-0eb29893ccc9 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-78f8cb94-e3af-4b69-8d79-0eb29893ccc9 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-78f8cb94-e3af-4b69-8d79-0eb29893ccc9 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:03 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-78f8cb94-e3af-4b69-8d79-0eb29893ccc9 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:13:03 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-78f8cb94-e3af-4b69-8d79-0eb29893ccc9 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653" status: 200 len: 1488 microversion: 2.1 time: 0.332753 Apr 13 15:13:03 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 117/349] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:13:03 2023] GET /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653 => generated 1488 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:13:08 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-b58678f3-963a-48ba-8f6f-8e1f1ca52fa3 req-82b8162d-4367-4d22-a15b-c3022c59ed53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b58678f3-963a-48ba-8f6f-8e1f1ca52fa3 req-82b8162d-4367-4d22-a15b-c3022c59ed53 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b58678f3-963a-48ba-8f6f-8e1f1ca52fa3 req-82b8162d-4367-4d22-a15b-c3022c59ed53 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b58678f3-963a-48ba-8f6f-8e1f1ca52fa3 req-82b8162d-4367-4d22-a15b-c3022c59ed53 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:08 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-b58678f3-963a-48ba-8f6f-8e1f1ca52fa3 req-82b8162d-4367-4d22-a15b-c3022c59ed53 service nova] Creating event network-vif-plugged:5eac5fa3-8589-47e1-8c93-bb65b7b095a1 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:13:08 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-b58678f3-963a-48ba-8f6f-8e1f1ca52fa3 req-82b8162d-4367-4d22-a15b-c3022c59ed53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049446 Apr 13 15:13:08 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 119/350] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:08 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-28804722-a812-499f-9210-dcf2cad8abc3 req-f5bf717e-42a5-4d36-a6e5-9783e02b1748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "26419cbf-54b6-47ab-a068-356727e4a6ca"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-28804722-a812-499f-9210-dcf2cad8abc3 req-f5bf717e-42a5-4d36-a6e5-9783e02b1748 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-28804722-a812-499f-9210-dcf2cad8abc3 req-f5bf717e-42a5-4d36-a6e5-9783e02b1748 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-28804722-a812-499f-9210-dcf2cad8abc3 req-f5bf717e-42a5-4d36-a6e5-9783e02b1748 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:08 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-28804722-a812-499f-9210-dcf2cad8abc3 req-f5bf717e-42a5-4d36-a6e5-9783e02b1748 service nova] Creating event network-vif-plugged:26419cbf-54b6-47ab-a068-356727e4a6ca for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:13:08 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-28804722-a812-499f-9210-dcf2cad8abc3 req-f5bf717e-42a5-4d36-a6e5-9783e02b1748 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054097 Apr 13 15:13:08 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 115/351] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:10 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1"}, {"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d"}, {"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d"}, {"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "b572fcf6-8374-49f4-b760-dc845d794668"}, {"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "b572fcf6-8374-49f4-b760-dc845d794668"}, {"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "dda3844e-0bda-47ff-8de6-25b9cde47976"}, {"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "dda3844e-0bda-47ff-8de6-25b9cde47976"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:10 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:13:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:10 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Creating event network-vif-plugged:5eac5fa3-8589-47e1-8c93-bb65b7b095a1 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:13:10 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Creating event network-vif-plugged:458d18a0-cd93-4e5f-8d97-842f7d0dc73d for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:13:10 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Creating event network-vif-plugged:458d18a0-cd93-4e5f-8d97-842f7d0dc73d for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:13:10 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Creating event network-vif-plugged:b572fcf6-8374-49f4-b760-dc845d794668 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:13:10 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Creating event network-vif-plugged:b572fcf6-8374-49f4-b760-dc845d794668 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:13:10 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Creating event network-vif-plugged:dda3844e-0bda-47ff-8de6-25b9cde47976 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:13:10 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Creating event network-vif-plugged:dda3844e-0bda-47ff-8de6-25b9cde47976 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:13:10 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.049660 Apr 13 15:13:10 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 118/352] 10.0.0.210 () {68 vars in 1395 bytes} [Thu Apr 13 15:13:10 2023] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:13:10 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-d451ea25-2c1c-4534-839b-6a82f524b51a req-1bcdb92d-3d45-4c5b-b466-afbcf981db34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "0f04a8c8-b74c-4ecf-9a72-0628b196102c"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d451ea25-2c1c-4534-839b-6a82f524b51a req-1bcdb92d-3d45-4c5b-b466-afbcf981db34 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d451ea25-2c1c-4534-839b-6a82f524b51a req-1bcdb92d-3d45-4c5b-b466-afbcf981db34 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d451ea25-2c1c-4534-839b-6a82f524b51a req-1bcdb92d-3d45-4c5b-b466-afbcf981db34 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:10 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-d451ea25-2c1c-4534-839b-6a82f524b51a req-1bcdb92d-3d45-4c5b-b466-afbcf981db34 service nova] Creating event network-vif-plugged:0f04a8c8-b74c-4ecf-9a72-0628b196102c for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:13:10 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-d451ea25-2c1c-4534-839b-6a82f524b51a req-1bcdb92d-3d45-4c5b-b466-afbcf981db34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034188 Apr 13 15:13:10 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 120/353] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:11 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "26419cbf-54b6-47ab-a068-356727e4a6ca"}, {"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2"}, {"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:11 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] Creating event network-vif-plugged:26419cbf-54b6-47ab-a068-356727e4a6ca for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:13:11 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] Creating event network-vif-plugged:c6f28318-b210-4a1d-8954-d7e8dc4b19e2 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:13:11 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] Creating event network-vif-plugged:c6f28318-b210-4a1d-8954-d7e8dc4b19e2 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:13:11 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.034075 Apr 13 15:13:11 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 116/354] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:11 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:11 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-b8d58f09-4287-4fc1-8447-02d63f1edf2e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:13:11 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-b8d58f09-4287-4fc1-8447-02d63f1edf2e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b8d58f09-4287-4fc1-8447-02d63f1edf2e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b8d58f09-4287-4fc1-8447-02d63f1edf2e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b8d58f09-4287-4fc1-8447-02d63f1edf2e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b8d58f09-4287-4fc1-8447-02d63f1edf2e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b8d58f09-4287-4fc1-8447-02d63f1edf2e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b8d58f09-4287-4fc1-8447-02d63f1edf2e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:11 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-b8d58f09-4287-4fc1-8447-02d63f1edf2e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:13:11 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-b8d58f09-4287-4fc1-8447-02d63f1edf2e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" status: 200 len: 1581 microversion: 2.1 time: 0.159482 Apr 13 15:13:11 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 119/355] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:13:11 2023] GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff => generated 1581 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:13:12 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-d45fb2f6-d7ad-4522-8fa8-c4d175cd6181 req-c209b538-5887-4653-a8df-b20f6cbaa457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "0f04a8c8-b74c-4ecf-9a72-0628b196102c"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d45fb2f6-d7ad-4522-8fa8-c4d175cd6181 req-c209b538-5887-4653-a8df-b20f6cbaa457 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d45fb2f6-d7ad-4522-8fa8-c4d175cd6181 req-c209b538-5887-4653-a8df-b20f6cbaa457 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d45fb2f6-d7ad-4522-8fa8-c4d175cd6181 req-c209b538-5887-4653-a8df-b20f6cbaa457 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:12 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-d45fb2f6-d7ad-4522-8fa8-c4d175cd6181 req-c209b538-5887-4653-a8df-b20f6cbaa457 service nova] Creating event network-vif-plugged:0f04a8c8-b74c-4ecf-9a72-0628b196102c for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:13:12 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-d45fb2f6-d7ad-4522-8fa8-c4d175cd6181 req-c209b538-5887-4653-a8df-b20f6cbaa457 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037618 Apr 13 15:13:12 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 121/356] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:14 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-d3c7f44d-cabc-465a-95d9-f9de76f4b754 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-173309121"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:14 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-d3c7f44d-cabc-465a-95d9-f9de76f4b754 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:14 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:13:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d3c7f44d-cabc-465a-95d9-f9de76f4b754 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d3c7f44d-cabc-465a-95d9-f9de76f4b754 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d3c7f44d-cabc-465a-95d9-f9de76f4b754 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d3c7f44d-cabc-465a-95d9-f9de76f4b754 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d3c7f44d-cabc-465a-95d9-f9de76f4b754 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d3c7f44d-cabc-465a-95d9-f9de76f4b754 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:14 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:13:14 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-cc7c08f3-326e-4a60-a453-df33c3ef7272 req-9f7418fe-a472-4b33-a1ea-58606a1bc88a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff", "tag": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:14 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=22 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:13:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-cc7c08f3-326e-4a60-a453-df33c3ef7272 req-9f7418fe-a472-4b33-a1ea-58606a1bc88a service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-cc7c08f3-326e-4a60-a453-df33c3ef7272 req-9f7418fe-a472-4b33-a1ea-58606a1bc88a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-cc7c08f3-326e-4a60-a453-df33c3ef7272 req-9f7418fe-a472-4b33-a1ea-58606a1bc88a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:14 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-cc7c08f3-326e-4a60-a453-df33c3ef7272 req-9f7418fe-a472-4b33-a1ea-58606a1bc88a service nova] Creating event network-changed:f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff on user Apr 13 15:13:14 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-cc7c08f3-326e-4a60-a453-df33c3ef7272 req-9f7418fe-a472-4b33-a1ea-58606a1bc88a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043248 Apr 13 15:13:14 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 120/357] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:14 user devstack@n-api.service[61871]: INFO nova.network.security_group_api [None req-d3c7f44d-cabc-465a-95d9-f9de76f4b754 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Adding security group a91149c1-17b5-4868-905e-4a008626e985 to port f7bf7380-3c36-4404-8bba-0f64c3fc59a3 Apr 13 15:13:15 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-d3c7f44d-cabc-465a-95d9-f9de76f4b754 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "POST /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/action" status: 202 len: 0 microversion: 2.1 time: 0.767748 Apr 13 15:13:15 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 117/358] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:13:14 2023] POST /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/action => generated 0 bytes in 769 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:13:15 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-8dc35b05-2906-4478-9110-e66f0161e948 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:13:15 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-8dc35b05-2906-4478-9110-e66f0161e948 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:15 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:13:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8dc35b05-2906-4478-9110-e66f0161e948 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8dc35b05-2906-4478-9110-e66f0161e948 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8dc35b05-2906-4478-9110-e66f0161e948 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8dc35b05-2906-4478-9110-e66f0161e948 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8dc35b05-2906-4478-9110-e66f0161e948 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8dc35b05-2906-4478-9110-e66f0161e948 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:15 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-11c80c9b-cbf4-435a-81c1-da9d94892b64 req-55b634d3-d909-4ec1-ac4b-af435873234d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff", "tag": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:15 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=24 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:13:15 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-11c80c9b-cbf4-435a-81c1-da9d94892b64 req-55b634d3-d909-4ec1-ac4b-af435873234d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:15 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-11c80c9b-cbf4-435a-81c1-da9d94892b64 req-55b634d3-d909-4ec1-ac4b-af435873234d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:15 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-11c80c9b-cbf4-435a-81c1-da9d94892b64 req-55b634d3-d909-4ec1-ac4b-af435873234d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:15 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-11c80c9b-cbf4-435a-81c1-da9d94892b64 req-55b634d3-d909-4ec1-ac4b-af435873234d service nova] Creating event network-changed:f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff on user Apr 13 15:13:15 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-11c80c9b-cbf4-435a-81c1-da9d94892b64 req-55b634d3-d909-4ec1-ac4b-af435873234d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051668 Apr 13 15:13:15 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 121/359] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:15 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-8dc35b05-2906-4478-9110-e66f0161e948 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:13:15 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-8dc35b05-2906-4478-9110-e66f0161e948 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" status: 200 len: 1745 microversion: 2.1 time: 0.188262 Apr 13 15:13:15 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 122/360] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:13:15 2023] GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 15:13:15 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-0d2fbd90-ed52-46be-aa00-f7ddd7fb69a7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:13:15 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-0d2fbd90-ed52-46be-aa00-f7ddd7fb69a7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0d2fbd90-ed52-46be-aa00-f7ddd7fb69a7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0d2fbd90-ed52-46be-aa00-f7ddd7fb69a7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0d2fbd90-ed52-46be-aa00-f7ddd7fb69a7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0d2fbd90-ed52-46be-aa00-f7ddd7fb69a7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0d2fbd90-ed52-46be-aa00-f7ddd7fb69a7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0d2fbd90-ed52-46be-aa00-f7ddd7fb69a7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:15 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-0d2fbd90-ed52-46be-aa00-f7ddd7fb69a7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:13:15 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-0d2fbd90-ed52-46be-aa00-f7ddd7fb69a7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:13:15 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-0d2fbd90-ed52-46be-aa00-f7ddd7fb69a7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:13:15 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-0d2fbd90-ed52-46be-aa00-f7ddd7fb69a7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473" status: 200 len: 1754 microversion: 2.87 time: 0.324833 Apr 13 15:13:15 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 118/361] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:13:15 2023] GET /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473 => generated 1754 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:13:17 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:17 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:17 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "POST /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/action" status: 202 len: 0 microversion: 2.1 time: 0.096175 Apr 13 15:13:17 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 122/362] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:13:17 2023] POST /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:13:17 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-586e484b-d5f4-4dbf-9791-c214a81a2bd6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:13:17 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-586e484b-d5f4-4dbf-9791-c214a81a2bd6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-586e484b-d5f4-4dbf-9791-c214a81a2bd6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-586e484b-d5f4-4dbf-9791-c214a81a2bd6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-586e484b-d5f4-4dbf-9791-c214a81a2bd6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-586e484b-d5f4-4dbf-9791-c214a81a2bd6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-586e484b-d5f4-4dbf-9791-c214a81a2bd6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-586e484b-d5f4-4dbf-9791-c214a81a2bd6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:18 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-586e484b-d5f4-4dbf-9791-c214a81a2bd6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:13:18 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-586e484b-d5f4-4dbf-9791-c214a81a2bd6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" status: 200 len: 1747 microversion: 2.1 time: 0.271938 Apr 13 15:13:18 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 123/363] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:13:17 2023] GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff => generated 1747 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:13:18 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-8633920f-1178-4c79-b98d-42e40b2e15e3 req-af038135-6353-4deb-a112-b651ab832652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff", "name": "network-vif-unplugged", "status": "completed", "tag": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-8633920f-1178-4c79-b98d-42e40b2e15e3 req-af038135-6353-4deb-a112-b651ab832652 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-8633920f-1178-4c79-b98d-42e40b2e15e3 req-af038135-6353-4deb-a112-b651ab832652 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-8633920f-1178-4c79-b98d-42e40b2e15e3 req-af038135-6353-4deb-a112-b651ab832652 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:18 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-8633920f-1178-4c79-b98d-42e40b2e15e3 req-af038135-6353-4deb-a112-b651ab832652 service nova] Creating event network-vif-unplugged:f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff on user Apr 13 15:13:18 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-8633920f-1178-4c79-b98d-42e40b2e15e3 req-af038135-6353-4deb-a112-b651ab832652 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037307 Apr 13 15:13:18 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 119/364] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:20 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-10d5ce1a-04d3-4902-a822-5c89923f04e0 req-665e9d56-0b5c-49b1-a1ed-59d8e2da42b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff", "name": "network-vif-plugged", "status": "completed", "tag": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-10d5ce1a-04d3-4902-a822-5c89923f04e0 req-665e9d56-0b5c-49b1-a1ed-59d8e2da42b1 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-10d5ce1a-04d3-4902-a822-5c89923f04e0 req-665e9d56-0b5c-49b1-a1ed-59d8e2da42b1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-10d5ce1a-04d3-4902-a822-5c89923f04e0 req-665e9d56-0b5c-49b1-a1ed-59d8e2da42b1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:20 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-10d5ce1a-04d3-4902-a822-5c89923f04e0 req-665e9d56-0b5c-49b1-a1ed-59d8e2da42b1 service nova] Creating event network-vif-plugged:f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff on user Apr 13 15:13:21 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-10d5ce1a-04d3-4902-a822-5c89923f04e0 req-665e9d56-0b5c-49b1-a1ed-59d8e2da42b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034406 Apr 13 15:13:21 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 123/365] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:23 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-960d77c5-0abe-473f-93e2-5e7e1801e0c3 req-e92151b2-53b5-4a2c-8ea7-2ff93b188344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff", "name": "network-vif-plugged", "status": "completed", "tag": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-960d77c5-0abe-473f-93e2-5e7e1801e0c3 req-e92151b2-53b5-4a2c-8ea7-2ff93b188344 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-960d77c5-0abe-473f-93e2-5e7e1801e0c3 req-e92151b2-53b5-4a2c-8ea7-2ff93b188344 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-960d77c5-0abe-473f-93e2-5e7e1801e0c3 req-e92151b2-53b5-4a2c-8ea7-2ff93b188344 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:23 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-960d77c5-0abe-473f-93e2-5e7e1801e0c3 req-e92151b2-53b5-4a2c-8ea7-2ff93b188344 service nova] Creating event network-vif-plugged:f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff on user Apr 13 15:13:23 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-960d77c5-0abe-473f-93e2-5e7e1801e0c3 req-e92151b2-53b5-4a2c-8ea7-2ff93b188344 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040616 Apr 13 15:13:23 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 124/366] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:23 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-b961056b-3f9d-47de-bee0-b11aee6bf9ad tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:23 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-b961056b-3f9d-47de-bee0-b11aee6bf9ad tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b961056b-3f9d-47de-bee0-b11aee6bf9ad tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b961056b-3f9d-47de-bee0-b11aee6bf9ad tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b961056b-3f9d-47de-bee0-b11aee6bf9ad tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b961056b-3f9d-47de-bee0-b11aee6bf9ad tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b961056b-3f9d-47de-bee0-b11aee6bf9ad tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b961056b-3f9d-47de-bee0-b11aee6bf9ad tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:23 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-b961056b-3f9d-47de-bee0-b11aee6bf9ad tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "POST /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818/action" status: 202 len: 0 microversion: 2.1 time: 0.202441 Apr 13 15:13:23 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 120/367] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:13:23 2023] POST /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:13:23 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-0d817e04-cf4e-4953-8f55-f2b5ac44e66d tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:13:23 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-0d817e04-cf4e-4953-8f55-f2b5ac44e66d tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0d817e04-cf4e-4953-8f55-f2b5ac44e66d tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0d817e04-cf4e-4953-8f55-f2b5ac44e66d tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0d817e04-cf4e-4953-8f55-f2b5ac44e66d tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0d817e04-cf4e-4953-8f55-f2b5ac44e66d tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0d817e04-cf4e-4953-8f55-f2b5ac44e66d tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0d817e04-cf4e-4953-8f55-f2b5ac44e66d tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:24 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-0d817e04-cf4e-4953-8f55-f2b5ac44e66d tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.210257 Apr 13 15:13:24 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 124/368] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 15:13:23 2023] GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818/os-interface => generated 282 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:24 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-517b530c-acaf-4929-b855-353f8a9599a5 req-5258174d-cf59-4aac-8e37-6e3596d351b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:24 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-517b530c-acaf-4929-b855-353f8a9599a5 req-5258174d-cf59-4aac-8e37-6e3596d351b4 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:24 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-517b530c-acaf-4929-b855-353f8a9599a5 req-5258174d-cf59-4aac-8e37-6e3596d351b4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:24 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-517b530c-acaf-4929-b855-353f8a9599a5 req-5258174d-cf59-4aac-8e37-6e3596d351b4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:24 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-517b530c-acaf-4929-b855-353f8a9599a5 req-5258174d-cf59-4aac-8e37-6e3596d351b4 service nova] Creating event network-changed:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:13:24 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-517b530c-acaf-4929-b855-353f8a9599a5 req-5258174d-cf59-4aac-8e37-6e3596d351b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037487 Apr 13 15:13:24 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 125/369] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:25 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff", "name": "network-vif-plugged", "status": "completed", "tag": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3"}, {"server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "name": "network-vif-unplugged", "status": "completed", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}, {"server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "name": "network-vif-plugged", "status": "completed", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:25 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] Creating event network-vif-plugged:f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff on user Apr 13 15:13:25 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] Creating event network-vif-unplugged:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:13:25 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] Creating event network-vif-plugged:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:13:25 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.040473 Apr 13 15:13:25 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 121/370] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:25 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:27 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-29f7e22d-0d02-4b99-9f52-c33f34c5ab33 req-e8a7ce72-04a4-4856-86e5-e9feba7e4caa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:27 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-29f7e22d-0d02-4b99-9f52-c33f34c5ab33 req-e8a7ce72-04a4-4856-86e5-e9feba7e4caa service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:27 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-29f7e22d-0d02-4b99-9f52-c33f34c5ab33 req-e8a7ce72-04a4-4856-86e5-e9feba7e4caa service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:27 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-29f7e22d-0d02-4b99-9f52-c33f34c5ab33 req-e8a7ce72-04a4-4856-86e5-e9feba7e4caa service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:27 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-29f7e22d-0d02-4b99-9f52-c33f34c5ab33 req-e8a7ce72-04a4-4856-86e5-e9feba7e4caa service nova] Creating event network-changed:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:13:27 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-29f7e22d-0d02-4b99-9f52-c33f34c5ab33 req-e8a7ce72-04a4-4856-86e5-e9feba7e4caa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032426 Apr 13 15:13:27 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 125/371] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:27 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-ec9a30fb-ad3a-4942-8ea3-33775828de1a tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:13:27 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-ec9a30fb-ad3a-4942-8ea3-33775828de1a tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ec9a30fb-ad3a-4942-8ea3-33775828de1a tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ec9a30fb-ad3a-4942-8ea3-33775828de1a tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ec9a30fb-ad3a-4942-8ea3-33775828de1a tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ec9a30fb-ad3a-4942-8ea3-33775828de1a tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ec9a30fb-ad3a-4942-8ea3-33775828de1a tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ec9a30fb-ad3a-4942-8ea3-33775828de1a tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:27 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-ec9a30fb-ad3a-4942-8ea3-33775828de1a tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc0cce3df7540078438186f46ca4621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7227559570b54e92be19d25938523b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:13:27 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-ec9a30fb-ad3a-4942-8ea3-33775828de1a tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211" status: 200 len: 1552 microversion: 2.1 time: 0.356618 Apr 13 15:13:27 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 126/372] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:13:27 2023] GET /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211 => generated 1552 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:13:27 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-07fcc372-1ecd-4761-8e44-7b45470fc198 req-f2822b6c-f6e4-49f2-97bd-b948ed20ded3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "name": "network-vif-plugged", "status": "completed", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:27 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-07fcc372-1ecd-4761-8e44-7b45470fc198 req-f2822b6c-f6e4-49f2-97bd-b948ed20ded3 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:27 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-07fcc372-1ecd-4761-8e44-7b45470fc198 req-f2822b6c-f6e4-49f2-97bd-b948ed20ded3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:27 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-07fcc372-1ecd-4761-8e44-7b45470fc198 req-f2822b6c-f6e4-49f2-97bd-b948ed20ded3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:27 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-07fcc372-1ecd-4761-8e44-7b45470fc198 req-f2822b6c-f6e4-49f2-97bd-b948ed20ded3 service nova] Creating event network-vif-plugged:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:13:27 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-07fcc372-1ecd-4761-8e44-7b45470fc198 req-f2822b6c-f6e4-49f2-97bd-b948ed20ded3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076903 Apr 13 15:13:27 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 122/373] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:29 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-b219de9f-ac2b-472d-8314-d93b80bd7dce req-5db05a0f-0b6d-4d11-82a3-7dcc62d1616e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "name": "network-vif-plugged", "status": "completed", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:29 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-b219de9f-ac2b-472d-8314-d93b80bd7dce req-5db05a0f-0b6d-4d11-82a3-7dcc62d1616e service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:29 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-b219de9f-ac2b-472d-8314-d93b80bd7dce req-5db05a0f-0b6d-4d11-82a3-7dcc62d1616e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:29 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-b219de9f-ac2b-472d-8314-d93b80bd7dce req-5db05a0f-0b6d-4d11-82a3-7dcc62d1616e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:29 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:13:29 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-b219de9f-ac2b-472d-8314-d93b80bd7dce req-5db05a0f-0b6d-4d11-82a3-7dcc62d1616e service nova] Creating event network-vif-plugged:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:13:29 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-b219de9f-ac2b-472d-8314-d93b80bd7dce req-5db05a0f-0b6d-4d11-82a3-7dcc62d1616e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034445 Apr 13 15:13:29 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 126/374] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:31 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-99190bc7-b1d9-43e1-aa05-6a98ad9b0f24 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:13:31 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-99190bc7-b1d9-43e1-aa05-6a98ad9b0f24 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-99190bc7-b1d9-43e1-aa05-6a98ad9b0f24 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-99190bc7-b1d9-43e1-aa05-6a98ad9b0f24 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-99190bc7-b1d9-43e1-aa05-6a98ad9b0f24 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-99190bc7-b1d9-43e1-aa05-6a98ad9b0f24 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-99190bc7-b1d9-43e1-aa05-6a98ad9b0f24 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-99190bc7-b1d9-43e1-aa05-6a98ad9b0f24 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:31 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-99190bc7-b1d9-43e1-aa05-6a98ad9b0f24 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] HTTP exception thrown: Instance 1c9a3524-caeb-4333-ae2b-1080115026fd could not be found. Apr 13 15:13:31 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-99190bc7-b1d9-43e1-aa05-6a98ad9b0f24 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Request method failure captured: Apr 13 15:13:31 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/1c9a3524-caeb-4333-ae2b-1080115026fd HTTP/1.1 Apr 13 15:13:31 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:13:31 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:13:31 user devstack@n-api.service[61873]: Connection: close Apr 13 15:13:31 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:13:31 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:13:31 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:13:31 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:13:31 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:13:31 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBt3vzdMP0YUp3fFnaU-54u96GQd1lcaZV59AxgHhylSZKTOiFPRA7dgu2A7HFuRKQHGbf3gt30Z1p9DMQ9aBxUY6YGBleKDSdmt9y0rkQdnEDmaa0jhLRDXH1L7mEJ7w2DnY-sb3RYHWd7ait-B2RKGcq6btONfKQyAn6GTLeU646c Apr 13 15:13:31 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:13:31 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:13:31 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:13:31 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:13:31 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:13:31 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:13:31 user devstack@n-api.service[61873]: X-Project-Id: 2c0cae04ab4b4157a7ef786d165789a6 Apr 13 15:13:31 user devstack@n-api.service[61873]: X-Project-Name: tempest-VolumesActionsTest-119634704 Apr 13 15:13:31 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:13:31 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:13:31 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c0cae04ab4b4157a7ef786d165789a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c0cae04ab4b4157a7ef786d165789a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c0cae04ab4b4157a7ef786d165789a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:13:31 user devstack@n-api.service[61873]: X-Tenant: tempest-VolumesActionsTest-119634704 Apr 13 15:13:31 user devstack@n-api.service[61873]: X-Tenant-Id: 2c0cae04ab4b4157a7ef786d165789a6 Apr 13 15:13:31 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-VolumesActionsTest-119634704 Apr 13 15:13:31 user devstack@n-api.service[61873]: X-User: tempest-VolumesActionsTest-119634704-project-member Apr 13 15:13:31 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:13:31 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:13:31 user devstack@n-api.service[61873]: X-User-Id: 3bdc942f33ca46c08bb143ed2efeb458 Apr 13 15:13:31 user devstack@n-api.service[61873]: X-User-Name: tempest-VolumesActionsTest-119634704-project-member Apr 13 15:13:31 user devstack@n-api.service[61873]: method: > Apr 13 15:13:31 user devstack@n-api.service[61873]: exception: Instance 1c9a3524-caeb-4333-ae2b-1080115026fd could not be found. Apr 13 15:13:31 user devstack@n-api.service[61873]: action_args: {'id': '1c9a3524-caeb-4333-ae2b-1080115026fd'} Apr 13 15:13:31 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c9a3524-caeb-4333-ae2b-1080115026fd could not be found. Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c9a3524-caeb-4333-ae2b-1080115026fd could not be found. Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c9a3524-caeb-4333-ae2b-1080115026fd could not be found. Apr 13 15:13:31 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:13:31 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-99190bc7-b1d9-43e1-aa05-6a98ad9b0f24 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Returning 404 to user: Instance 1c9a3524-caeb-4333-ae2b-1080115026fd could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:13:31 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-99190bc7-b1d9-43e1-aa05-6a98ad9b0f24 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c9a3524-caeb-4333-ae2b-1080115026fd" status: 404 len: 111 microversion: 2.1 time: 0.042204 Apr 13 15:13:31 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 127/375] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:13:31 2023] GET /compute/v2.1/servers/1c9a3524-caeb-4333-ae2b-1080115026fd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:13:31 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1355034600", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "networks": [{"uuid": "e03ac49b-a391-40fb-930c-49644a153431"}]}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:31 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] validate_networks() for [('e03ac49b-a391-40fb-930c-49644a153431', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:13:32 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-6ff7c206-ceca-48ce-a428-60792158ff80 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:13:32 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-6ff7c206-ceca-48ce-a428-60792158ff80 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6ff7c206-ceca-48ce-a428-60792158ff80 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6ff7c206-ceca-48ce-a428-60792158ff80 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6ff7c206-ceca-48ce-a428-60792158ff80 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6ff7c206-ceca-48ce-a428-60792158ff80 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6ff7c206-ceca-48ce-a428-60792158ff80 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6ff7c206-ceca-48ce-a428-60792158ff80 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:32 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:13:32 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:13:32 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:13:32 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:13:32 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:13:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:32 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-6ff7c206-ceca-48ce-a428-60792158ff80 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.123948 Apr 13 15:13:32 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 127/376] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 15:13:32 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/os-interface => generated 282 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:32 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Getting quotas for project 2c0cae04ab4b4157a7ef786d165789a6. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:13:32 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Getting quotas for user 3bdc942f33ca46c08bb143ed2efeb458 and project 2c0cae04ab4b4157a7ef786d165789a6. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:13:32 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:13:32 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:13:32 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.666798 Apr 13 15:13:32 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 123/377] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:13:31 2023] POST /compute/v2.1/servers => generated 378 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:13:32 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f1ff9fa7-a5c4-4c74-a4f4-4fa37617b0e1 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:13:32 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-f1ff9fa7-a5c4-4c74-a4f4-4fa37617b0e1 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:32 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-f1ff9fa7-a5c4-4c74-a4f4-4fa37617b0e1 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc942f33ca46c08bb143ed2efeb458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0cae04ab4b4157a7ef786d165789a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:13:32 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-f1ff9fa7-a5c4-4c74-a4f4-4fa37617b0e1 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" status: 200 len: 1208 microversion: 2.1 time: 0.060465 Apr 13 15:13:32 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 128/378] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:13:32 2023] GET /compute/v2.1/servers/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae => generated 1208 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 15:13:33 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-44087bd2-bb33-4364-8706-9577742562fd req-38f4bae0-2ce6-4b83-b0b6-1a7af9a252ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc7b5bd-5f78-448e-bd82-74b2263dff75", "tag": "9c8ad360-aa62-4ef1-952f-d73f885baa89"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-44087bd2-bb33-4364-8706-9577742562fd req-38f4bae0-2ce6-4b83-b0b6-1a7af9a252ea service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-44087bd2-bb33-4364-8706-9577742562fd req-38f4bae0-2ce6-4b83-b0b6-1a7af9a252ea service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-44087bd2-bb33-4364-8706-9577742562fd req-38f4bae0-2ce6-4b83-b0b6-1a7af9a252ea service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:33 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-44087bd2-bb33-4364-8706-9577742562fd req-38f4bae0-2ce6-4b83-b0b6-1a7af9a252ea service nova] Creating event network-changed:9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 on user Apr 13 15:13:33 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-44087bd2-bb33-4364-8706-9577742562fd req-38f4bae0-2ce6-4b83-b0b6-1a7af9a252ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030830 Apr 13 15:13:33 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 128/379] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:33 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-e5ed6f65-dc9e-42b2-a7f8-a1604a8ae0d3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:13:33 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-e5ed6f65-dc9e-42b2-a7f8-a1604a8ae0d3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e5ed6f65-dc9e-42b2-a7f8-a1604a8ae0d3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e5ed6f65-dc9e-42b2-a7f8-a1604a8ae0d3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e5ed6f65-dc9e-42b2-a7f8-a1604a8ae0d3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e5ed6f65-dc9e-42b2-a7f8-a1604a8ae0d3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e5ed6f65-dc9e-42b2-a7f8-a1604a8ae0d3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e5ed6f65-dc9e-42b2-a7f8-a1604a8ae0d3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:33 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7d35a534-cb08-470c-abed-ef506d96c46b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:13:33 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-7d35a534-cb08-470c-abed-ef506d96c46b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7d35a534-cb08-470c-abed-ef506d96c46b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7d35a534-cb08-470c-abed-ef506d96c46b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7d35a534-cb08-470c-abed-ef506d96c46b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7d35a534-cb08-470c-abed-ef506d96c46b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7d35a534-cb08-470c-abed-ef506d96c46b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7d35a534-cb08-470c-abed-ef506d96c46b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:34 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-e5ed6f65-dc9e-42b2-a7f8-a1604a8ae0d3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:13:34 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-e5ed6f65-dc9e-42b2-a7f8-a1604a8ae0d3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1538 microversion: 2.1 time: 0.226831 Apr 13 15:13:34 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 124/380] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:13:33 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1538 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:13:34 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-4c3e5e7c-5ef6-480c-b6f5-05a0ebd0fc60 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:13:34 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-4c3e5e7c-5ef6-480c-b6f5-05a0ebd0fc60 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:34 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4c3e5e7c-5ef6-480c-b6f5-05a0ebd0fc60 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:34 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4c3e5e7c-5ef6-480c-b6f5-05a0ebd0fc60 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:34 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4c3e5e7c-5ef6-480c-b6f5-05a0ebd0fc60 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:34 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4c3e5e7c-5ef6-480c-b6f5-05a0ebd0fc60 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:34 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4c3e5e7c-5ef6-480c-b6f5-05a0ebd0fc60 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:34 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4c3e5e7c-5ef6-480c-b6f5-05a0ebd0fc60 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:34 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-7d35a534-cb08-470c-abed-ef506d96c46b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1a698b103a47c0b2864eef54be648b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceba33821a9b4f7aa81c2857c11261f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:13:34 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7d35a534-cb08-470c-abed-ef506d96c46b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3" status: 200 len: 1536 microversion: 2.1 time: 0.289552 Apr 13 15:13:34 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 129/381] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:13:33 2023] GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3 => generated 1536 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:13:34 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-4c3e5e7c-5ef6-480c-b6f5-05a0ebd0fc60 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:13:34 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-4c3e5e7c-5ef6-480c-b6f5-05a0ebd0fc60 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1538 microversion: 2.1 time: 0.371026 Apr 13 15:13:34 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 129/382] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:13:34 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1538 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:13:34 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c48067db-c9a7-4c70-b9af-45abeb06bc68 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:13:34 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-c48067db-c9a7-4c70-b9af-45abeb06bc68 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c48067db-c9a7-4c70-b9af-45abeb06bc68 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c48067db-c9a7-4c70-b9af-45abeb06bc68 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c48067db-c9a7-4c70-b9af-45abeb06bc68 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c48067db-c9a7-4c70-b9af-45abeb06bc68 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c48067db-c9a7-4c70-b9af-45abeb06bc68 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c48067db-c9a7-4c70-b9af-45abeb06bc68 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:34 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-c48067db-c9a7-4c70-b9af-45abeb06bc68 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc549309fa74c0a8eb2f44e5959ce92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac94a736e99f4f978f043f2b1b929284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:13:34 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-c48067db-c9a7-4c70-b9af-45abeb06bc68 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dc549309fa74c0a8eb2f44e5959ce92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac94a736e99f4f978f043f2b1b929284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:13:34 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-c48067db-c9a7-4c70-b9af-45abeb06bc68 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dc549309fa74c0a8eb2f44e5959ce92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac94a736e99f4f978f043f2b1b929284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:13:34 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-c48067db-c9a7-4c70-b9af-45abeb06bc68 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350" status: 200 len: 2819 microversion: 2.42 time: 0.339443 Apr 13 15:13:34 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 125/383] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:13:34 2023] GET /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350 => generated 2819 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:13:35 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-a39eabda-e461-494b-8d93-91197a783caf req-ee9466f2-86f7-48ff-8c05-5b5a5c931c06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae", "tag": "ec148848-53a7-4ed8-8105-7d95722393bc"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-a39eabda-e461-494b-8d93-91197a783caf req-ee9466f2-86f7-48ff-8c05-5b5a5c931c06 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-a39eabda-e461-494b-8d93-91197a783caf req-ee9466f2-86f7-48ff-8c05-5b5a5c931c06 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-a39eabda-e461-494b-8d93-91197a783caf req-ee9466f2-86f7-48ff-8c05-5b5a5c931c06 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:35 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-a39eabda-e461-494b-8d93-91197a783caf req-ee9466f2-86f7-48ff-8c05-5b5a5c931c06 service nova] Creating event network-changed:ec148848-53a7-4ed8-8105-7d95722393bc for instance 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae on user Apr 13 15:13:35 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-a39eabda-e461-494b-8d93-91197a783caf req-ee9466f2-86f7-48ff-8c05-5b5a5c931c06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029241 Apr 13 15:13:35 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 130/384] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:37 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d1aef11c-6078-4abb-9f9d-5362b81c7b2b tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:13:37 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-d1aef11c-6078-4abb-9f9d-5362b81c7b2b tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d1aef11c-6078-4abb-9f9d-5362b81c7b2b tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d1aef11c-6078-4abb-9f9d-5362b81c7b2b tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d1aef11c-6078-4abb-9f9d-5362b81c7b2b tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d1aef11c-6078-4abb-9f9d-5362b81c7b2b tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d1aef11c-6078-4abb-9f9d-5362b81c7b2b tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d1aef11c-6078-4abb-9f9d-5362b81c7b2b tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:37 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-d1aef11c-6078-4abb-9f9d-5362b81c7b2b tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] HTTP exception thrown: Instance bfc41492-c482-4a9f-8a5b-9d7520dea39a could not be found. Apr 13 15:13:37 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d1aef11c-6078-4abb-9f9d-5362b81c7b2b tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Request method failure captured: Apr 13 15:13:37 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/bfc41492-c482-4a9f-8a5b-9d7520dea39a HTTP/1.1 Apr 13 15:13:37 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:13:37 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:13:37 user devstack@n-api.service[61872]: Connection: close Apr 13 15:13:37 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:13:37 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:13:37 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:13:37 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:13:37 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:13:37 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBqq7yexofsWPeAAtfVJd7Suld1XNgqa7z86nMvDSr6n-BRAx70SSVq1xTRFdef2kVrqNA7MLliC_hDsdZEMZuu29BkZ8d3adw9L3fKFu1q9Lnt382nJnBZ8l1ovXr72J9tqjMa5dGpBKqdjRAyFGDnOe3xbWZg2_OytgApn8rZNlG0 Apr 13 15:13:37 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:13:37 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:13:37 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:13:37 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:13:37 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:13:37 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:13:37 user devstack@n-api.service[61872]: X-Project-Id: 8f7b81912360422a8413f8760b0cf7e1 Apr 13 15:13:37 user devstack@n-api.service[61872]: X-Project-Name: tempest-VolumesAdminNegativeTest-721367972 Apr 13 15:13:37 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:13:37 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:13:37 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8f7b81912360422a8413f8760b0cf7e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f7b81912360422a8413f8760b0cf7e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f7b81912360422a8413f8760b0cf7e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:13:37 user devstack@n-api.service[61872]: X-Tenant: tempest-VolumesAdminNegativeTest-721367972 Apr 13 15:13:37 user devstack@n-api.service[61872]: X-Tenant-Id: 8f7b81912360422a8413f8760b0cf7e1 Apr 13 15:13:37 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-721367972 Apr 13 15:13:37 user devstack@n-api.service[61872]: X-User: tempest-VolumesAdminNegativeTest-721367972-project-member Apr 13 15:13:37 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:13:37 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:13:37 user devstack@n-api.service[61872]: X-User-Id: 54b07929cf2c404ab10ce944437e9e97 Apr 13 15:13:37 user devstack@n-api.service[61872]: X-User-Name: tempest-VolumesAdminNegativeTest-721367972-project-member Apr 13 15:13:37 user devstack@n-api.service[61872]: method: > Apr 13 15:13:37 user devstack@n-api.service[61872]: exception: Instance bfc41492-c482-4a9f-8a5b-9d7520dea39a could not be found. Apr 13 15:13:37 user devstack@n-api.service[61872]: action_args: {'id': 'bfc41492-c482-4a9f-8a5b-9d7520dea39a'} Apr 13 15:13:37 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfc41492-c482-4a9f-8a5b-9d7520dea39a could not be found. Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfc41492-c482-4a9f-8a5b-9d7520dea39a could not be found. Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfc41492-c482-4a9f-8a5b-9d7520dea39a could not be found. Apr 13 15:13:37 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:13:37 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d1aef11c-6078-4abb-9f9d-5362b81c7b2b tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Returning 404 to user: Instance bfc41492-c482-4a9f-8a5b-9d7520dea39a could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:13:37 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-d1aef11c-6078-4abb-9f9d-5362b81c7b2b tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfc41492-c482-4a9f-8a5b-9d7520dea39a" status: 404 len: 111 microversion: 2.1 time: 0.169962 Apr 13 15:13:37 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 130/385] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:13:37 2023] GET /compute/v2.1/servers/bfc41492-c482-4a9f-8a5b-9d7520dea39a => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:13:37 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-1dc9cb76-d967-49eb-80da-28780a4823c7 req-faab7822-0b87-439d-9f43-848905561214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae", "name": "network-vif-plugged", "status": "completed", "tag": "ec148848-53a7-4ed8-8105-7d95722393bc"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-1dc9cb76-d967-49eb-80da-28780a4823c7 req-faab7822-0b87-439d-9f43-848905561214 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-1dc9cb76-d967-49eb-80da-28780a4823c7 req-faab7822-0b87-439d-9f43-848905561214 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-1dc9cb76-d967-49eb-80da-28780a4823c7 req-faab7822-0b87-439d-9f43-848905561214 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:37 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-1dc9cb76-d967-49eb-80da-28780a4823c7 req-faab7822-0b87-439d-9f43-848905561214 service nova] Creating event network-vif-plugged:ec148848-53a7-4ed8-8105-7d95722393bc for instance 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae on user Apr 13 15:13:37 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-1dc9cb76-d967-49eb-80da-28780a4823c7 req-faab7822-0b87-439d-9f43-848905561214 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032499 Apr 13 15:13:37 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 126/386] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:39 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-3fd9fec1-6f37-4f80-ae7c-3613a84200ed req-0ec8120a-ee1e-463c-86b6-22202d163463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae", "name": "network-vif-plugged", "status": "completed", "tag": "ec148848-53a7-4ed8-8105-7d95722393bc"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:39 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:13:39 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:39 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3fd9fec1-6f37-4f80-ae7c-3613a84200ed req-0ec8120a-ee1e-463c-86b6-22202d163463 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:39 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3fd9fec1-6f37-4f80-ae7c-3613a84200ed req-0ec8120a-ee1e-463c-86b6-22202d163463 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:39 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3fd9fec1-6f37-4f80-ae7c-3613a84200ed req-0ec8120a-ee1e-463c-86b6-22202d163463 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:40 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-3fd9fec1-6f37-4f80-ae7c-3613a84200ed req-0ec8120a-ee1e-463c-86b6-22202d163463 service nova] Creating event network-vif-plugged:ec148848-53a7-4ed8-8105-7d95722393bc for instance 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae on user Apr 13 15:13:40 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-3fd9fec1-6f37-4f80-ae7c-3613a84200ed req-0ec8120a-ee1e-463c-86b6-22202d163463 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057479 Apr 13 15:13:40 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 131/387] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:40 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Going to try to terminate instance {{(pid=61872) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:13:40 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719" status: 204 len: 0 microversion: 2.1 time: 0.139327 Apr 13 15:13:40 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 131/388] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:13:39 2023] DELETE /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:13:40 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-6e8bb4df-afd4-4daf-811f-76ea150453ab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:13:40 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-6e8bb4df-afd4-4daf-811f-76ea150453ab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6e8bb4df-afd4-4daf-811f-76ea150453ab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6e8bb4df-afd4-4daf-811f-76ea150453ab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6e8bb4df-afd4-4daf-811f-76ea150453ab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6e8bb4df-afd4-4daf-811f-76ea150453ab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6e8bb4df-afd4-4daf-811f-76ea150453ab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6e8bb4df-afd4-4daf-811f-76ea150453ab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:40 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-6e8bb4df-afd4-4daf-811f-76ea150453ab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b07929cf2c404ab10ce944437e9e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7b81912360422a8413f8760b0cf7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:13:40 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-6e8bb4df-afd4-4daf-811f-76ea150453ab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719" status: 200 len: 1669 microversion: 2.1 time: 0.253372 Apr 13 15:13:40 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 127/389] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:13:40 2023] GET /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719 => generated 1669 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:13:40 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-5e564bd4-ff1b-4a0b-bfee-231d5eeb0280 req-3cc81b5d-e727-4ce8-a126-b18ecb422f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be0a3f9-0dae-4739-9f1e-0bb416a97719", "name": "network-vif-unplugged", "status": "completed", "tag": "daee05dc-ae07-4d68-94f3-7c2ee8039327"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5e564bd4-ff1b-4a0b-bfee-231d5eeb0280 req-3cc81b5d-e727-4ce8-a126-b18ecb422f68 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5e564bd4-ff1b-4a0b-bfee-231d5eeb0280 req-3cc81b5d-e727-4ce8-a126-b18ecb422f68 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5e564bd4-ff1b-4a0b-bfee-231d5eeb0280 req-3cc81b5d-e727-4ce8-a126-b18ecb422f68 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:40 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-5e564bd4-ff1b-4a0b-bfee-231d5eeb0280 req-3cc81b5d-e727-4ce8-a126-b18ecb422f68 service nova] Creating event network-vif-unplugged:daee05dc-ae07-4d68-94f3-7c2ee8039327 for instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 on user Apr 13 15:13:40 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-5e564bd4-ff1b-4a0b-bfee-231d5eeb0280 req-3cc81b5d-e727-4ce8-a126-b18ecb422f68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044014 Apr 13 15:13:40 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 132/390] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:13:42 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-15c6d8a6-e5e6-41cd-8a5c-05f4a00f5746 req-2717fcf6-a0ef-4a56-b93a-f2a1de755da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be0a3f9-0dae-4739-9f1e-0bb416a97719", "name": "network-vif-plugged", "status": "completed", "tag": "daee05dc-ae07-4d68-94f3-7c2ee8039327"}, {"server_uuid": "1be0a3f9-0dae-4739-9f1e-0bb416a97719", "name": "network-vif-deleted", "tag": "daee05dc-ae07-4d68-94f3-7c2ee8039327"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:13:42 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-15c6d8a6-e5e6-41cd-8a5c-05f4a00f5746 req-2717fcf6-a0ef-4a56-b93a-f2a1de755da1 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:42 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-15c6d8a6-e5e6-41cd-8a5c-05f4a00f5746 req-2717fcf6-a0ef-4a56-b93a-f2a1de755da1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:42 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-15c6d8a6-e5e6-41cd-8a5c-05f4a00f5746 req-2717fcf6-a0ef-4a56-b93a-f2a1de755da1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:42 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-15c6d8a6-e5e6-41cd-8a5c-05f4a00f5746 req-2717fcf6-a0ef-4a56-b93a-f2a1de755da1 service nova] Creating event network-vif-plugged:daee05dc-ae07-4d68-94f3-7c2ee8039327 for instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 on user Apr 13 15:13:42 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-15c6d8a6-e5e6-41cd-8a5c-05f4a00f5746 req-2717fcf6-a0ef-4a56-b93a-f2a1de755da1 service nova] Creating event network-vif-deleted:daee05dc-ae07-4d68-94f3-7c2ee8039327 for instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 on user Apr 13 15:13:42 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-15c6d8a6-e5e6-41cd-8a5c-05f4a00f5746 req-2717fcf6-a0ef-4a56-b93a-f2a1de755da1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030467 Apr 13 15:13:42 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 132/391] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:13:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:13:56 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:13:56 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:56 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:13:56 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:13:56 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:13:56 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:13:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:56 user devstack@n-api.service[61871]: DEBUG nova.objects.instance [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lazy-loading 'services' on Instance uuid 654608ee-5897-429a-b19c-6845d4e84818 {{(pid=61871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:13:56 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818/os-volume_attachments/5579543e-1e86-4db2-b6b5-4a2ff31d59b1" status: 202 len: 0 microversion: 2.1 time: 0.186422 Apr 13 15:13:56 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 128/392] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:13:56 2023] DELETE /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818/os-volume_attachments/5579543e-1e86-4db2-b6b5-4a2ff31d59b1 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:13:56 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:13:56 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=23 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:13:56 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=35 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:13:56 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-e7a0f6e6-7397-433f-96c0-cba40b73f415 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:13:56 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-e7a0f6e6-7397-433f-96c0-cba40b73f415 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:13:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e7a0f6e6-7397-433f-96c0-cba40b73f415 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e7a0f6e6-7397-433f-96c0-cba40b73f415 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e7a0f6e6-7397-433f-96c0-cba40b73f415 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e7a0f6e6-7397-433f-96c0-cba40b73f415 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:13:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e7a0f6e6-7397-433f-96c0-cba40b73f415 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:13:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e7a0f6e6-7397-433f-96c0-cba40b73f415 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:13:56 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-e7a0f6e6-7397-433f-96c0-cba40b73f415 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052474 Apr 13 15:13:56 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 133/393] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:13:56 2023] GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:03 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:14:03 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:14:03 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-2fe49f12-fd7b-439f-a2a6-d58e4365f217 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91d5ea59-6347-447a-b02e-fa305f2ed662"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:03 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-2fe49f12-fd7b-439f-a2a6-d58e4365f217 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2fe49f12-fd7b-439f-a2a6-d58e4365f217 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2fe49f12-fd7b-439f-a2a6-d58e4365f217 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2fe49f12-fd7b-439f-a2a6-d58e4365f217 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2fe49f12-fd7b-439f-a2a6-d58e4365f217 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2fe49f12-fd7b-439f-a2a6-d58e4365f217 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2fe49f12-fd7b-439f-a2a6-d58e4365f217 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:03 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-2fe49f12-fd7b-439f-a2a6-d58e4365f217 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] HTTP exception thrown: Cannot 'attach_volume' instance f54cffe3-73da-468b-8252-b74cb4ba9653 while it is in vm_state rescued Apr 13 15:14:03 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-2fe49f12-fd7b-439f-a2a6-d58e4365f217 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Request method failure captured: Apr 13 15:14:03 user devstack@n-api.service[61872]: request: POST /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653/os-volume_attachments HTTP/1.1 Apr 13 15:14:03 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:14:03 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:14:03 user devstack@n-api.service[61872]: Connection: close Apr 13 15:14:03 user devstack@n-api.service[61872]: Content-Length: 74 Apr 13 15:14:03 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:14:03 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:14:03 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:14:03 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:14:03 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBqsGdw3aycWoeNTF5dIwz9M4XoihFvfDydEnbooAOgxqZE-k6qSuH5o67HiM2sVa6RcOyUtIsnkDUaPOUoPWZlOnWwrJAmh2HS8sFequPAvZEFaKGsiH5QLqfUXGyfRHGhNYdseVYaXNX3DzwjC8qCRhoxAP0-nP_gTeqRe2MpQXfI Apr 13 15:14:03 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:14:03 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:14:03 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:14:03 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:14:03 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:14:03 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:14:03 user devstack@n-api.service[61872]: X-Project-Id: 9bad96fcfa0d4691af2a7990ba9dbd09 Apr 13 15:14:03 user devstack@n-api.service[61872]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-66620130 Apr 13 15:14:03 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:14:03 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:14:03 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9bad96fcfa0d4691af2a7990ba9dbd09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bad96fcfa0d4691af2a7990ba9dbd09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bad96fcfa0d4691af2a7990ba9dbd09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:14:03 user devstack@n-api.service[61872]: X-Tenant: tempest-ServerRescueNegativeTestJSON-66620130 Apr 13 15:14:03 user devstack@n-api.service[61872]: X-Tenant-Id: 9bad96fcfa0d4691af2a7990ba9dbd09 Apr 13 15:14:03 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-66620130 Apr 13 15:14:03 user devstack@n-api.service[61872]: X-User: tempest-ServerRescueNegativeTestJSON-66620130-project-member Apr 13 15:14:03 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:14:03 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:14:03 user devstack@n-api.service[61872]: X-User-Id: c83940ddaaf64d94b40df9d00349aa91 Apr 13 15:14:03 user devstack@n-api.service[61872]: X-User-Name: tempest-ServerRescueNegativeTestJSON-66620130-project-member Apr 13 15:14:03 user devstack@n-api.service[61872]: Apr 13 15:14:03 user devstack@n-api.service[61872]: {"volumeAttachment": {"volumeId": "91d5ea59-6347-447a-b02e-fa305f2ed662"}} Apr 13 15:14:03 user devstack@n-api.service[61872]: method: > Apr 13 15:14:03 user devstack@n-api.service[61872]: exception: Cannot 'attach_volume' instance f54cffe3-73da-468b-8252-b74cb4ba9653 while it is in vm_state rescued Apr 13 15:14:03 user devstack@n-api.service[61872]: action_args: {'server_id': 'f54cffe3-73da-468b-8252-b74cb4ba9653', 'body': {'volumeAttachment': {'volumeId': '91d5ea59-6347-447a-b02e-fa305f2ed662'}}} Apr 13 15:14:03 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f54cffe3-73da-468b-8252-b74cb4ba9653 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f54cffe3-73da-468b-8252-b74cb4ba9653 while it is in vm_state rescued Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f54cffe3-73da-468b-8252-b74cb4ba9653 while it is in vm_state rescued Apr 13 15:14:03 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:03 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-2fe49f12-fd7b-439f-a2a6-d58e4365f217 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Returning 409 to user: Cannot 'attach_volume' instance f54cffe3-73da-468b-8252-b74cb4ba9653 while it is in vm_state rescued {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:14:03 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-2fe49f12-fd7b-439f-a2a6-d58e4365f217 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.070536 Apr 13 15:14:03 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 133/394] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:14:03 2023] POST /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653/os-volume_attachments => generated 152 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 13 15:14:03 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-86a6bc27-5812-44c2-98fc-0e4e8b267e9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:03 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-86a6bc27-5812-44c2-98fc-0e4e8b267e9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:03 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-86a6bc27-5812-44c2-98fc-0e4e8b267e9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:03 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-86a6bc27-5812-44c2-98fc-0e4e8b267e9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:03 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-86a6bc27-5812-44c2-98fc-0e4e8b267e9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:03 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-86a6bc27-5812-44c2-98fc-0e4e8b267e9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:03 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-86a6bc27-5812-44c2-98fc-0e4e8b267e9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:03 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-86a6bc27-5812-44c2-98fc-0e4e8b267e9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:03 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-86a6bc27-5812-44c2-98fc-0e4e8b267e9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653/action" status: 202 len: 0 microversion: 2.1 time: 0.073466 Apr 13 15:14:03 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 129/395] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:14:03 2023] POST /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:14:03 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-5ea9599b-39e5-4fe5-9ee9-5e01b35b7b5d tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:03 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-5ea9599b-39e5-4fe5-9ee9-5e01b35b7b5d tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5ea9599b-39e5-4fe5-9ee9-5e01b35b7b5d tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5ea9599b-39e5-4fe5-9ee9-5e01b35b7b5d tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5ea9599b-39e5-4fe5-9ee9-5e01b35b7b5d tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5ea9599b-39e5-4fe5-9ee9-5e01b35b7b5d tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5ea9599b-39e5-4fe5-9ee9-5e01b35b7b5d tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5ea9599b-39e5-4fe5-9ee9-5e01b35b7b5d tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:03 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-5ea9599b-39e5-4fe5-9ee9-5e01b35b7b5d tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:14:03 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-5ea9599b-39e5-4fe5-9ee9-5e01b35b7b5d tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653" status: 200 len: 1496 microversion: 2.1 time: 0.236452 Apr 13 15:14:03 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 134/396] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:14:03 2023] GET /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653 => generated 1496 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:14:04 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-2c5e8aaa-b9f9-4ccd-afad-3b44ec2c32cc req-336c716f-af7a-481f-b804-3b83745ae114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f54cffe3-73da-468b-8252-b74cb4ba9653", "name": "network-vif-unplugged", "status": "completed", "tag": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-2c5e8aaa-b9f9-4ccd-afad-3b44ec2c32cc req-336c716f-af7a-481f-b804-3b83745ae114 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-2c5e8aaa-b9f9-4ccd-afad-3b44ec2c32cc req-336c716f-af7a-481f-b804-3b83745ae114 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-2c5e8aaa-b9f9-4ccd-afad-3b44ec2c32cc req-336c716f-af7a-481f-b804-3b83745ae114 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:04 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-2c5e8aaa-b9f9-4ccd-afad-3b44ec2c32cc req-336c716f-af7a-481f-b804-3b83745ae114 service nova] Creating event network-vif-unplugged:0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance f54cffe3-73da-468b-8252-b74cb4ba9653 on user Apr 13 15:14:04 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-2c5e8aaa-b9f9-4ccd-afad-3b44ec2c32cc req-336c716f-af7a-481f-b804-3b83745ae114 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032762 Apr 13 15:14:04 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 134/397] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-ad8168aa-be52-4f6b-b67a-e3cb21f9c214 req-f913152a-39ec-4a65-b446-8bf23f525719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f54cffe3-73da-468b-8252-b74cb4ba9653", "name": "network-vif-plugged", "status": "completed", "tag": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d"}, {"server_uuid": "f54cffe3-73da-468b-8252-b74cb4ba9653", "name": "network-vif-plugged", "status": "completed", "tag": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ad8168aa-be52-4f6b-b67a-e3cb21f9c214 req-f913152a-39ec-4a65-b446-8bf23f525719 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ad8168aa-be52-4f6b-b67a-e3cb21f9c214 req-f913152a-39ec-4a65-b446-8bf23f525719 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ad8168aa-be52-4f6b-b67a-e3cb21f9c214 req-f913152a-39ec-4a65-b446-8bf23f525719 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:06 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-ad8168aa-be52-4f6b-b67a-e3cb21f9c214 req-f913152a-39ec-4a65-b446-8bf23f525719 service nova] Creating event network-vif-plugged:0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance f54cffe3-73da-468b-8252-b74cb4ba9653 on user Apr 13 15:14:06 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-ad8168aa-be52-4f6b-b67a-e3cb21f9c214 req-f913152a-39ec-4a65-b446-8bf23f525719 service nova] Creating event network-vif-plugged:0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance f54cffe3-73da-468b-8252-b74cb4ba9653 on user Apr 13 15:14:06 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-ad8168aa-be52-4f6b-b67a-e3cb21f9c214 req-f913152a-39ec-4a65-b446-8bf23f525719 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033073 Apr 13 15:14:06 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 130/398] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:08 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-ab170268-9f0f-4bcb-9d38-77bb694ce8b6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:08 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-ab170268-9f0f-4bcb-9d38-77bb694ce8b6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ab170268-9f0f-4bcb-9d38-77bb694ce8b6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ab170268-9f0f-4bcb-9d38-77bb694ce8b6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ab170268-9f0f-4bcb-9d38-77bb694ce8b6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ab170268-9f0f-4bcb-9d38-77bb694ce8b6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ab170268-9f0f-4bcb-9d38-77bb694ce8b6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ab170268-9f0f-4bcb-9d38-77bb694ce8b6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:08 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-ab170268-9f0f-4bcb-9d38-77bb694ce8b6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:14:08 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-ab170268-9f0f-4bcb-9d38-77bb694ce8b6 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" status: 200 len: 1745 microversion: 2.1 time: 0.169082 Apr 13 15:14:08 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 135/399] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:14:08 2023] GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:14:08 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-2d12bc8d-1fb5-4f05-92e3-e0ab2cb29867 req-16171f63-a4bf-4087-9497-e879c5234d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f54cffe3-73da-468b-8252-b74cb4ba9653", "name": "network-vif-plugged", "status": "completed", "tag": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:08 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-2d12bc8d-1fb5-4f05-92e3-e0ab2cb29867 req-16171f63-a4bf-4087-9497-e879c5234d58 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:08 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-2d12bc8d-1fb5-4f05-92e3-e0ab2cb29867 req-16171f63-a4bf-4087-9497-e879c5234d58 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:08 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-2d12bc8d-1fb5-4f05-92e3-e0ab2cb29867 req-16171f63-a4bf-4087-9497-e879c5234d58 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:08 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-2d12bc8d-1fb5-4f05-92e3-e0ab2cb29867 req-16171f63-a4bf-4087-9497-e879c5234d58 service nova] Creating event network-vif-plugged:0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance f54cffe3-73da-468b-8252-b74cb4ba9653 on user Apr 13 15:14:08 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-2d12bc8d-1fb5-4f05-92e3-e0ab2cb29867 req-16171f63-a4bf-4087-9497-e879c5234d58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036124 Apr 13 15:14:08 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 135/400] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:15 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-a2318b3d-79b9-4968-85f0-97dadc325135 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:15 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-a2318b3d-79b9-4968-85f0-97dadc325135 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a2318b3d-79b9-4968-85f0-97dadc325135 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a2318b3d-79b9-4968-85f0-97dadc325135 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a2318b3d-79b9-4968-85f0-97dadc325135 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a2318b3d-79b9-4968-85f0-97dadc325135 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a2318b3d-79b9-4968-85f0-97dadc325135 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a2318b3d-79b9-4968-85f0-97dadc325135 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:15 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-a2318b3d-79b9-4968-85f0-97dadc325135 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473/action" status: 202 len: 0 microversion: 2.87 time: 0.069305 Apr 13 15:14:15 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 131/401] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 15:14:15 2023] POST /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473/action => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:14:15 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-d7617f53-7506-444e-a6a6-87304383b046 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:15 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-d7617f53-7506-444e-a6a6-87304383b046 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d7617f53-7506-444e-a6a6-87304383b046 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d7617f53-7506-444e-a6a6-87304383b046 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d7617f53-7506-444e-a6a6-87304383b046 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d7617f53-7506-444e-a6a6-87304383b046 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d7617f53-7506-444e-a6a6-87304383b046 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d7617f53-7506-444e-a6a6-87304383b046 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:16 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-d7617f53-7506-444e-a6a6-87304383b046 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:14:16 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-d7617f53-7506-444e-a6a6-87304383b046 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:14:16 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-d7617f53-7506-444e-a6a6-87304383b046 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:14:16 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-d7617f53-7506-444e-a6a6-87304383b046 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473" status: 200 len: 1762 microversion: 2.87 time: 0.226409 Apr 13 15:14:16 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 136/402] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:14:15 2023] GET /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473 => generated 1762 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:14:16 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-9323015b-4cac-4509-a21a-81ccdf34bd33 req-099375ca-fd26-41dc-999d-4f2f6af7e502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0a9548-9e57-4007-bafb-d418a4433473", "name": "network-vif-unplugged", "status": "completed", "tag": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-9323015b-4cac-4509-a21a-81ccdf34bd33 req-099375ca-fd26-41dc-999d-4f2f6af7e502 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-9323015b-4cac-4509-a21a-81ccdf34bd33 req-099375ca-fd26-41dc-999d-4f2f6af7e502 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-9323015b-4cac-4509-a21a-81ccdf34bd33 req-099375ca-fd26-41dc-999d-4f2f6af7e502 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:16 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-9323015b-4cac-4509-a21a-81ccdf34bd33 req-099375ca-fd26-41dc-999d-4f2f6af7e502 service nova] Creating event network-vif-unplugged:0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance 0a0a9548-9e57-4007-bafb-d418a4433473 on user Apr 13 15:14:16 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-9323015b-4cac-4509-a21a-81ccdf34bd33 req-099375ca-fd26-41dc-999d-4f2f6af7e502 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035762 Apr 13 15:14:16 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 136/403] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:18 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-a28c48c3-6ea5-47d0-b52c-226b177deb16 req-bce962b2-c6e6-4bbe-94ee-da4608a7aeaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0a9548-9e57-4007-bafb-d418a4433473", "name": "network-vif-plugged", "status": "completed", "tag": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e"}, {"server_uuid": "0a0a9548-9e57-4007-bafb-d418a4433473", "name": "network-vif-plugged", "status": "completed", "tag": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a28c48c3-6ea5-47d0-b52c-226b177deb16 req-bce962b2-c6e6-4bbe-94ee-da4608a7aeaf service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a28c48c3-6ea5-47d0-b52c-226b177deb16 req-bce962b2-c6e6-4bbe-94ee-da4608a7aeaf service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a28c48c3-6ea5-47d0-b52c-226b177deb16 req-bce962b2-c6e6-4bbe-94ee-da4608a7aeaf service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:18 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-a28c48c3-6ea5-47d0-b52c-226b177deb16 req-bce962b2-c6e6-4bbe-94ee-da4608a7aeaf service nova] Creating event network-vif-plugged:0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance 0a0a9548-9e57-4007-bafb-d418a4433473 on user Apr 13 15:14:18 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-a28c48c3-6ea5-47d0-b52c-226b177deb16 req-bce962b2-c6e6-4bbe-94ee-da4608a7aeaf service nova] Creating event network-vif-plugged:0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance 0a0a9548-9e57-4007-bafb-d418a4433473 on user Apr 13 15:14:18 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-a28c48c3-6ea5-47d0-b52c-226b177deb16 req-bce962b2-c6e6-4bbe-94ee-da4608a7aeaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043081 Apr 13 15:14:18 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 132/404] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:20 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-21b87001-871c-4580-81e6-4208dc6b3f04 req-2302ee6d-47a9-4644-a7ed-0de342299f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0a9548-9e57-4007-bafb-d418a4433473", "name": "network-vif-plugged", "status": "completed", "tag": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-21b87001-871c-4580-81e6-4208dc6b3f04 req-2302ee6d-47a9-4644-a7ed-0de342299f58 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-21b87001-871c-4580-81e6-4208dc6b3f04 req-2302ee6d-47a9-4644-a7ed-0de342299f58 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-21b87001-871c-4580-81e6-4208dc6b3f04 req-2302ee6d-47a9-4644-a7ed-0de342299f58 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:20 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-21b87001-871c-4580-81e6-4208dc6b3f04 req-2302ee6d-47a9-4644-a7ed-0de342299f58 service nova] Creating event network-vif-plugged:0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance 0a0a9548-9e57-4007-bafb-d418a4433473 on user Apr 13 15:14:20 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-21b87001-871c-4580-81e6-4208dc6b3f04 req-2302ee6d-47a9-4644-a7ed-0de342299f58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029402 Apr 13 15:14:20 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 137/405] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:22 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-f28de163-07d3-428d-bcd2-8b42f67076aa tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:22 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-f28de163-07d3-428d-bcd2-8b42f67076aa tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f28de163-07d3-428d-bcd2-8b42f67076aa tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f28de163-07d3-428d-bcd2-8b42f67076aa tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f28de163-07d3-428d-bcd2-8b42f67076aa tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f28de163-07d3-428d-bcd2-8b42f67076aa tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f28de163-07d3-428d-bcd2-8b42f67076aa tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f28de163-07d3-428d-bcd2-8b42f67076aa tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:22 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-f28de163-07d3-428d-bcd2-8b42f67076aa tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc942f33ca46c08bb143ed2efeb458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0cae04ab4b4157a7ef786d165789a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:14:22 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-f28de163-07d3-428d-bcd2-8b42f67076aa tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" status: 200 len: 1486 microversion: 2.1 time: 0.148265 Apr 13 15:14:22 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 137/406] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:14:22 2023] GET /compute/v2.1/servers/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae => generated 1486 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:14:24 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-12e08379-ca30-413d-bff4-03ed325f131d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:24 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-12e08379-ca30-413d-bff4-03ed325f131d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-12e08379-ca30-413d-bff4-03ed325f131d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-12e08379-ca30-413d-bff4-03ed325f131d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-12e08379-ca30-413d-bff4-03ed325f131d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-12e08379-ca30-413d-bff4-03ed325f131d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-12e08379-ca30-413d-bff4-03ed325f131d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-12e08379-ca30-413d-bff4-03ed325f131d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:24 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-12e08379-ca30-413d-bff4-03ed325f131d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:14:24 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-12e08379-ca30-413d-bff4-03ed325f131d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1657 microversion: 2.1 time: 0.173473 Apr 13 15:14:24 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 133/407] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:14:24 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1657 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:14:24 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-df352c63-70a1-41ee-825b-9b9be3d1379f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:24 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-df352c63-70a1-41ee-825b-9b9be3d1379f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:24 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-df352c63-70a1-41ee-825b-9b9be3d1379f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:24 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-df352c63-70a1-41ee-825b-9b9be3d1379f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:24 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-df352c63-70a1-41ee-825b-9b9be3d1379f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:24 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-df352c63-70a1-41ee-825b-9b9be3d1379f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:24 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-df352c63-70a1-41ee-825b-9b9be3d1379f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:24 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-df352c63-70a1-41ee-825b-9b9be3d1379f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:25 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-df352c63-70a1-41ee-825b-9b9be3d1379f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:14:25 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-df352c63-70a1-41ee-825b-9b9be3d1379f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1657 microversion: 2.1 time: 0.477985 Apr 13 15:14:25 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 138/408] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:14:24 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1657 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:14:28 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:28 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:28 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-4db5bb64-f642-4871-92aa-e1440b307572 req-dfd2ac9f-353e-4c9b-96c4-5ed047ee0ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179b6945-589d-402c-a89e-6b8d68725211", "tag": "b6a42460-29f0-496d-a7ba-d7ae2259f317"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:28 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=13 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:14:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-4db5bb64-f642-4871-92aa-e1440b307572 req-dfd2ac9f-353e-4c9b-96c4-5ed047ee0ce5 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-4db5bb64-f642-4871-92aa-e1440b307572 req-dfd2ac9f-353e-4c9b-96c4-5ed047ee0ce5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-4db5bb64-f642-4871-92aa-e1440b307572 req-dfd2ac9f-353e-4c9b-96c4-5ed047ee0ce5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:28 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=40,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:14:28 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-4db5bb64-f642-4871-92aa-e1440b307572 req-dfd2ac9f-353e-4c9b-96c4-5ed047ee0ce5 service nova] Creating event network-changed:b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance 179b6945-589d-402c-a89e-6b8d68725211 on user Apr 13 15:14:28 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-4db5bb64-f642-4871-92aa-e1440b307572 req-dfd2ac9f-353e-4c9b-96c4-5ed047ee0ce5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033689 Apr 13 15:14:28 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 134/409] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:28 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Going to try to terminate instance {{(pid=61872) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:14:28 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211" status: 204 len: 0 microversion: 2.1 time: 0.131664 Apr 13 15:14:28 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 138/410] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:14:28 2023] DELETE /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:14:28 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-bdd54cf9-dbd1-42db-9616-7ea900d0aa56 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:28 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-bdd54cf9-dbd1-42db-9616-7ea900d0aa56 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:28 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=15 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:14:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-bdd54cf9-dbd1-42db-9616-7ea900d0aa56 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-bdd54cf9-dbd1-42db-9616-7ea900d0aa56 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-bdd54cf9-dbd1-42db-9616-7ea900d0aa56 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-bdd54cf9-dbd1-42db-9616-7ea900d0aa56 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-bdd54cf9-dbd1-42db-9616-7ea900d0aa56 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-bdd54cf9-dbd1-42db-9616-7ea900d0aa56 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:28 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=33 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:14:28 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-12285ff3-7602-40cb-8186-a836adc9d492 req-7917dc20-fcc2-4525-b975-db20cc57a7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179b6945-589d-402c-a89e-6b8d68725211", "name": "network-vif-unplugged", "status": "completed", "tag": "b6a42460-29f0-496d-a7ba-d7ae2259f317"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:28 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-bdd54cf9-dbd1-42db-9616-7ea900d0aa56 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc0cce3df7540078438186f46ca4621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7227559570b54e92be19d25938523b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:14:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-12285ff3-7602-40cb-8186-a836adc9d492 req-7917dc20-fcc2-4525-b975-db20cc57a7d0 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-12285ff3-7602-40cb-8186-a836adc9d492 req-7917dc20-fcc2-4525-b975-db20cc57a7d0 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-12285ff3-7602-40cb-8186-a836adc9d492 req-7917dc20-fcc2-4525-b975-db20cc57a7d0 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:28 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-bdd54cf9-dbd1-42db-9616-7ea900d0aa56 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211" status: 200 len: 1558 microversion: 2.1 time: 0.266660 Apr 13 15:14:28 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 139/411] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:14:28 2023] GET /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211 => generated 1558 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:14:28 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-12285ff3-7602-40cb-8186-a836adc9d492 req-7917dc20-fcc2-4525-b975-db20cc57a7d0 service nova] Creating event network-vif-unplugged:b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance 179b6945-589d-402c-a89e-6b8d68725211 on user Apr 13 15:14:28 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-12285ff3-7602-40cb-8186-a836adc9d492 req-7917dc20-fcc2-4525-b975-db20cc57a7d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033349 Apr 13 15:14:28 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 135/412] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:30 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-783d8d5b-0ceb-449d-8f84-ea8cedb66235 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:30 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-783d8d5b-0ceb-449d-8f84-ea8cedb66235 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:30 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-783d8d5b-0ceb-449d-8f84-ea8cedb66235 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:30 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-783d8d5b-0ceb-449d-8f84-ea8cedb66235 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:30 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-783d8d5b-0ceb-449d-8f84-ea8cedb66235 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:30 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-783d8d5b-0ceb-449d-8f84-ea8cedb66235 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:30 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-783d8d5b-0ceb-449d-8f84-ea8cedb66235 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:30 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-783d8d5b-0ceb-449d-8f84-ea8cedb66235 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:30 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-783d8d5b-0ceb-449d-8f84-ea8cedb66235 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] HTTP exception thrown: Instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 could not be found. Apr 13 15:14:30 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-783d8d5b-0ceb-449d-8f84-ea8cedb66235 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Request method failure captured: Apr 13 15:14:30 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719 HTTP/1.1 Apr 13 15:14:30 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:14:30 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:14:30 user devstack@n-api.service[61872]: Connection: close Apr 13 15:14:30 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:14:30 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:14:30 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:14:30 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:14:30 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:14:30 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBqq7yexofsWPeAAtfVJd7Suld1XNgqa7z86nMvDSr6n-BRAx70SSVq1xTRFdef2kVrqNA7MLliC_hDsdZEMZuu29BkZ8d3adw9L3fKFu1q9Lnt382nJnBZ8l1ovXr72J9tqjMa5dGpBKqdjRAyFGDnOe3xbWZg2_OytgApn8rZNlG0 Apr 13 15:14:30 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:14:30 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:14:30 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:14:30 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:14:30 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:14:30 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:14:30 user devstack@n-api.service[61872]: X-Project-Id: 8f7b81912360422a8413f8760b0cf7e1 Apr 13 15:14:30 user devstack@n-api.service[61872]: X-Project-Name: tempest-VolumesAdminNegativeTest-721367972 Apr 13 15:14:30 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:14:30 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:14:30 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8f7b81912360422a8413f8760b0cf7e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f7b81912360422a8413f8760b0cf7e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f7b81912360422a8413f8760b0cf7e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:14:30 user devstack@n-api.service[61872]: X-Tenant: tempest-VolumesAdminNegativeTest-721367972 Apr 13 15:14:30 user devstack@n-api.service[61872]: X-Tenant-Id: 8f7b81912360422a8413f8760b0cf7e1 Apr 13 15:14:30 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-721367972 Apr 13 15:14:30 user devstack@n-api.service[61872]: X-User: tempest-VolumesAdminNegativeTest-721367972-project-member Apr 13 15:14:30 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:14:30 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:14:30 user devstack@n-api.service[61872]: X-User-Id: 54b07929cf2c404ab10ce944437e9e97 Apr 13 15:14:30 user devstack@n-api.service[61872]: X-User-Name: tempest-VolumesAdminNegativeTest-721367972-project-member Apr 13 15:14:30 user devstack@n-api.service[61872]: method: > Apr 13 15:14:30 user devstack@n-api.service[61872]: exception: Instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 could not be found. Apr 13 15:14:30 user devstack@n-api.service[61872]: action_args: {'id': '1be0a3f9-0dae-4739-9f1e-0bb416a97719'} Apr 13 15:14:30 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 could not be found. Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 could not be found. Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 could not be found. Apr 13 15:14:30 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:30 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-783d8d5b-0ceb-449d-8f84-ea8cedb66235 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Returning 404 to user: Instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:14:30 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-783d8d5b-0ceb-449d-8f84-ea8cedb66235 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719" status: 404 len: 111 microversion: 2.1 time: 0.034357 Apr 13 15:14:30 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 139/413] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:14:30 2023] GET /compute/v2.1/servers/1be0a3f9-0dae-4739-9f1e-0bb416a97719 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:14:30 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-b96a5ac1-75d7-43d5-87c6-79f99dfc169a tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Calling method '.version_select at 0x7f3a8badf6d0>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:30 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-b96a5ac1-75d7-43d5-87c6-79f99dfc169a tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-38678878" status: 202 len: 0 microversion: 2.1 time: 0.029038 Apr 13 15:14:30 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 140/414] 10.0.0.210 () {62 vars in 1292 bytes} [Thu Apr 13 15:14:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-38678878 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:14:30 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-5741920c-464b-4d7b-8059-34e3a0e19a7d req-5525c188-d34a-4d27-af4c-16e1b264ea85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179b6945-589d-402c-a89e-6b8d68725211", "name": "network-vif-deleted", "tag": "b6a42460-29f0-496d-a7ba-d7ae2259f317"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:30 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-5741920c-464b-4d7b-8059-34e3a0e19a7d req-5525c188-d34a-4d27-af4c-16e1b264ea85 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:30 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-5741920c-464b-4d7b-8059-34e3a0e19a7d req-5525c188-d34a-4d27-af4c-16e1b264ea85 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:30 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-5741920c-464b-4d7b-8059-34e3a0e19a7d req-5525c188-d34a-4d27-af4c-16e1b264ea85 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:30 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-5741920c-464b-4d7b-8059-34e3a0e19a7d req-5525c188-d34a-4d27-af4c-16e1b264ea85 service nova] Creating event network-vif-deleted:b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance 179b6945-589d-402c-a89e-6b8d68725211 on user Apr 13 15:14:30 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-5741920c-464b-4d7b-8059-34e3a0e19a7d req-5525c188-d34a-4d27-af4c-16e1b264ea85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030581 Apr 13 15:14:30 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 136/415] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:30 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-a804b34e-d38c-49f8-b06b-0eb346dd1ece req-c5944543-6851-488d-84fc-91a5a89393a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179b6945-589d-402c-a89e-6b8d68725211", "name": "network-vif-plugged", "status": "completed", "tag": "b6a42460-29f0-496d-a7ba-d7ae2259f317"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:30 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a804b34e-d38c-49f8-b06b-0eb346dd1ece req-c5944543-6851-488d-84fc-91a5a89393a6 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:30 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a804b34e-d38c-49f8-b06b-0eb346dd1ece req-c5944543-6851-488d-84fc-91a5a89393a6 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:30 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a804b34e-d38c-49f8-b06b-0eb346dd1ece req-c5944543-6851-488d-84fc-91a5a89393a6 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:30 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-a804b34e-d38c-49f8-b06b-0eb346dd1ece req-c5944543-6851-488d-84fc-91a5a89393a6 service nova] Creating event network-vif-plugged:b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance 179b6945-589d-402c-a89e-6b8d68725211 on user Apr 13 15:14:30 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-a804b34e-d38c-49f8-b06b-0eb346dd1ece req-c5944543-6851-488d-84fc-91a5a89393a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034034 Apr 13 15:14:30 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 140/416] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:34 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-da9b716d-cd7a-47aa-bd87-191330cae2c3 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:34 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-da9b716d-cd7a-47aa-bd87-191330cae2c3 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:34 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-da9b716d-cd7a-47aa-bd87-191330cae2c3 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:34 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-da9b716d-cd7a-47aa-bd87-191330cae2c3 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:34 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-da9b716d-cd7a-47aa-bd87-191330cae2c3 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:34 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-da9b716d-cd7a-47aa-bd87-191330cae2c3 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:34 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-da9b716d-cd7a-47aa-bd87-191330cae2c3 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:34 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-da9b716d-cd7a-47aa-bd87-191330cae2c3 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:34 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-da9b716d-cd7a-47aa-bd87-191330cae2c3 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.107031 Apr 13 15:14:34 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 141/417] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 15:14:34 2023] GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3/os-interface => generated 283 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:34 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-fcace980-da60-4adf-b2dc-0718af1818fe tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:34 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-fcace980-da60-4adf-b2dc-0718af1818fe tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fcace980-da60-4adf-b2dc-0718af1818fe tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fcace980-da60-4adf-b2dc-0718af1818fe tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fcace980-da60-4adf-b2dc-0718af1818fe tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fcace980-da60-4adf-b2dc-0718af1818fe tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fcace980-da60-4adf-b2dc-0718af1818fe tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fcace980-da60-4adf-b2dc-0718af1818fe tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:34 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-fcace980-da60-4adf-b2dc-0718af1818fe tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.128785 Apr 13 15:14:34 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 137/418] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 15:14:34 2023] GET /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350/os-interface => generated 1829 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:14:36 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-e6c5db80-7593-4db4-95f7-4eb24a31576f req-4f4a068f-af6f-45eb-a087-76172b8a93b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa74d14-db6f-41f5-b8af-32da312209d3", "tag": "84611f06-d6ca-49e1-afe7-7723921e62dc"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:36 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:14:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-e6c5db80-7593-4db4-95f7-4eb24a31576f req-4f4a068f-af6f-45eb-a087-76172b8a93b1 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-e6c5db80-7593-4db4-95f7-4eb24a31576f req-4f4a068f-af6f-45eb-a087-76172b8a93b1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-e6c5db80-7593-4db4-95f7-4eb24a31576f req-4f4a068f-af6f-45eb-a087-76172b8a93b1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:36 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:14:36 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-e6c5db80-7593-4db4-95f7-4eb24a31576f req-4f4a068f-af6f-45eb-a087-76172b8a93b1 service nova] Creating event network-changed:84611f06-d6ca-49e1-afe7-7723921e62dc for instance 1aa74d14-db6f-41f5-b8af-32da312209d3 on user Apr 13 15:14:36 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-e6c5db80-7593-4db4-95f7-4eb24a31576f req-4f4a068f-af6f-45eb-a087-76172b8a93b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033378 Apr 13 15:14:36 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 141/419] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:36 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-2c885885-3152-475d-ac25-3f230aabbf2b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:36 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-2c885885-3152-475d-ac25-3f230aabbf2b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2c885885-3152-475d-ac25-3f230aabbf2b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2c885885-3152-475d-ac25-3f230aabbf2b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2c885885-3152-475d-ac25-3f230aabbf2b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2c885885-3152-475d-ac25-3f230aabbf2b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2c885885-3152-475d-ac25-3f230aabbf2b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2c885885-3152-475d-ac25-3f230aabbf2b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:36 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-2c885885-3152-475d-ac25-3f230aabbf2b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3/ips" status: 200 len: 105 microversion: 2.1 time: 0.045057 Apr 13 15:14:36 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 142/420] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 15:14:36 2023] GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3/ips => generated 105 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:36 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-4dcdfcd8-da71-4e3a-ba71-bb728aa0031d req-5cf0cb1d-5134-44b4-9f91-a2ff6b64a04a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "tag": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:36 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-4dcdfcd8-da71-4e3a-ba71-bb728aa0031d req-5cf0cb1d-5134-44b4-9f91-a2ff6b64a04a service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:36 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-4dcdfcd8-da71-4e3a-ba71-bb728aa0031d req-5cf0cb1d-5134-44b4-9f91-a2ff6b64a04a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:36 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-4dcdfcd8-da71-4e3a-ba71-bb728aa0031d req-5cf0cb1d-5134-44b4-9f91-a2ff6b64a04a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:36 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-4dcdfcd8-da71-4e3a-ba71-bb728aa0031d req-5cf0cb1d-5134-44b4-9f91-a2ff6b64a04a service nova] Creating event network-changed:5eac5fa3-8589-47e1-8c93-bb65b7b095a1 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:36 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-4dcdfcd8-da71-4e3a-ba71-bb728aa0031d req-5cf0cb1d-5134-44b4-9f91-a2ff6b64a04a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046393 Apr 13 15:14:36 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 138/421] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:36 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-92219fcd-8a67-46ce-b65a-0966399dc352 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:36 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-92219fcd-8a67-46ce-b65a-0966399dc352 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-92219fcd-8a67-46ce-b65a-0966399dc352 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-92219fcd-8a67-46ce-b65a-0966399dc352 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-92219fcd-8a67-46ce-b65a-0966399dc352 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-92219fcd-8a67-46ce-b65a-0966399dc352 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-92219fcd-8a67-46ce-b65a-0966399dc352 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-92219fcd-8a67-46ce-b65a-0966399dc352 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:37 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-92219fcd-8a67-46ce-b65a-0966399dc352 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc549309fa74c0a8eb2f44e5959ce92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac94a736e99f4f978f043f2b1b929284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:14:37 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-92219fcd-8a67-46ce-b65a-0966399dc352 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dc549309fa74c0a8eb2f44e5959ce92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac94a736e99f4f978f043f2b1b929284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:14:37 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-92219fcd-8a67-46ce-b65a-0966399dc352 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dc549309fa74c0a8eb2f44e5959ce92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac94a736e99f4f978f043f2b1b929284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:14:37 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-92219fcd-8a67-46ce-b65a-0966399dc352 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350" status: 200 len: 2819 microversion: 2.42 time: 0.418483 Apr 13 15:14:37 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 142/422] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:14:36 2023] GET /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350 => generated 2819 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:14:37 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-505537c7-d22b-43be-a59e-9889ed58317a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:37 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-505537c7-d22b-43be-a59e-9889ed58317a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-505537c7-d22b-43be-a59e-9889ed58317a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-505537c7-d22b-43be-a59e-9889ed58317a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-505537c7-d22b-43be-a59e-9889ed58317a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-505537c7-d22b-43be-a59e-9889ed58317a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-505537c7-d22b-43be-a59e-9889ed58317a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-505537c7-d22b-43be-a59e-9889ed58317a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:37 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-505537c7-d22b-43be-a59e-9889ed58317a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.188888 Apr 13 15:14:37 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 143/423] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 15:14:37 2023] GET /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350/os-interface => generated 1829 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:14:37 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "833def22-5680-4c24-9368-2130eefccdfc"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:37 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:37 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289670 Apr 13 15:14:37 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 139/424] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:14:37 2023] POST /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:38 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:38 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:38 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:38 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:38 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:38 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:38 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:38 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:38 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Going to try to terminate instance {{(pid=61872) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:14:38 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350" status: 204 len: 0 microversion: 2.42 time: 0.119717 Apr 13 15:14:38 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 143/425] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 15:14:38 2023] DELETE /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 15:14:38 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c53f7c66-d1a2-4e50-9f3b-6900ccf24579 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:38 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-c53f7c66-d1a2-4e50-9f3b-6900ccf24579 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c53f7c66-d1a2-4e50-9f3b-6900ccf24579 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c53f7c66-d1a2-4e50-9f3b-6900ccf24579 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c53f7c66-d1a2-4e50-9f3b-6900ccf24579 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c53f7c66-d1a2-4e50-9f3b-6900ccf24579 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c53f7c66-d1a2-4e50-9f3b-6900ccf24579 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c53f7c66-d1a2-4e50-9f3b-6900ccf24579 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:38 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-c53f7c66-d1a2-4e50-9f3b-6900ccf24579 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc549309fa74c0a8eb2f44e5959ce92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac94a736e99f4f978f043f2b1b929284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:14:38 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-c53f7c66-d1a2-4e50-9f3b-6900ccf24579 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dc549309fa74c0a8eb2f44e5959ce92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac94a736e99f4f978f043f2b1b929284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:14:38 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-c53f7c66-d1a2-4e50-9f3b-6900ccf24579 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dc549309fa74c0a8eb2f44e5959ce92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac94a736e99f4f978f043f2b1b929284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:14:38 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-c53f7c66-d1a2-4e50-9f3b-6900ccf24579 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350" status: 200 len: 2943 microversion: 2.42 time: 0.333534 Apr 13 15:14:38 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 144/426] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:14:38 2023] GET /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350 => generated 2943 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:14:38 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-0c433c05-596d-4e67-84ce-6309469e3153 req-32da1046-5c19-416b-886f-34ea91277017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-unplugged", "status": "completed", "tag": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-0c433c05-596d-4e67-84ce-6309469e3153 req-32da1046-5c19-416b-886f-34ea91277017 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-0c433c05-596d-4e67-84ce-6309469e3153 req-32da1046-5c19-416b-886f-34ea91277017 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-0c433c05-596d-4e67-84ce-6309469e3153 req-32da1046-5c19-416b-886f-34ea91277017 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:38 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-0c433c05-596d-4e67-84ce-6309469e3153 req-32da1046-5c19-416b-886f-34ea91277017 service nova] Creating event network-vif-unplugged:5eac5fa3-8589-47e1-8c93-bb65b7b095a1 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:38 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-0c433c05-596d-4e67-84ce-6309469e3153 req-32da1046-5c19-416b-886f-34ea91277017 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042665 Apr 13 15:14:38 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 140/427] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:39 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-b6454007-6f04-47ea-b9d2-95951a8b29c9 req-8c686e57-67c2-429b-a6f1-a18333e616ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-unplugged", "status": "completed", "tag": "26419cbf-54b6-47ab-a068-356727e4a6ca"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-b6454007-6f04-47ea-b9d2-95951a8b29c9 req-8c686e57-67c2-429b-a6f1-a18333e616ee service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-b6454007-6f04-47ea-b9d2-95951a8b29c9 req-8c686e57-67c2-429b-a6f1-a18333e616ee service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-b6454007-6f04-47ea-b9d2-95951a8b29c9 req-8c686e57-67c2-429b-a6f1-a18333e616ee service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:39 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-b6454007-6f04-47ea-b9d2-95951a8b29c9 req-8c686e57-67c2-429b-a6f1-a18333e616ee service nova] Creating event network-vif-unplugged:26419cbf-54b6-47ab-a068-356727e4a6ca for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:39 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-b6454007-6f04-47ea-b9d2-95951a8b29c9 req-8c686e57-67c2-429b-a6f1-a18333e616ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038368 Apr 13 15:14:39 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 144/428] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:39 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-7c9d36c7-99e5-4e8f-b135-8f17fe3751ed req-7fafd567-f8e1-4fba-89d6-c64c5bfee28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-unplugged", "status": "completed", "tag": "0f04a8c8-b74c-4ecf-9a72-0628b196102c"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:39 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-7c9d36c7-99e5-4e8f-b135-8f17fe3751ed req-7fafd567-f8e1-4fba-89d6-c64c5bfee28f service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:39 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-7c9d36c7-99e5-4e8f-b135-8f17fe3751ed req-7fafd567-f8e1-4fba-89d6-c64c5bfee28f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:39 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-7c9d36c7-99e5-4e8f-b135-8f17fe3751ed req-7fafd567-f8e1-4fba-89d6-c64c5bfee28f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:39 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-7c9d36c7-99e5-4e8f-b135-8f17fe3751ed req-7fafd567-f8e1-4fba-89d6-c64c5bfee28f service nova] Creating event network-vif-unplugged:0f04a8c8-b74c-4ecf-9a72-0628b196102c for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:39 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-7c9d36c7-99e5-4e8f-b135-8f17fe3751ed req-7fafd567-f8e1-4fba-89d6-c64c5bfee28f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059613 Apr 13 15:14:39 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 145/429] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:40 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1"}, {"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-unplugged", "status": "completed", "tag": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d"}, {"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d"}, {"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-unplugged", "status": "completed", "tag": "b572fcf6-8374-49f4-b760-dc845d794668"}, {"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "b572fcf6-8374-49f4-b760-dc845d794668"}, {"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-unplugged", "status": "completed", "tag": "dda3844e-0bda-47ff-8de6-25b9cde47976"}, {"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "dda3844e-0bda-47ff-8de6-25b9cde47976"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:40 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Creating event network-vif-plugged:5eac5fa3-8589-47e1-8c93-bb65b7b095a1 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:40 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Creating event network-vif-unplugged:458d18a0-cd93-4e5f-8d97-842f7d0dc73d for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:40 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Creating event network-vif-plugged:458d18a0-cd93-4e5f-8d97-842f7d0dc73d for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:40 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Creating event network-vif-unplugged:b572fcf6-8374-49f4-b760-dc845d794668 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:40 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Creating event network-vif-plugged:b572fcf6-8374-49f4-b760-dc845d794668 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:40 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Creating event network-vif-unplugged:dda3844e-0bda-47ff-8de6-25b9cde47976 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:40 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Creating event network-vif-plugged:dda3844e-0bda-47ff-8de6-25b9cde47976 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:40 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.032846 Apr 13 15:14:40 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 141/430] 10.0.0.210 () {68 vars in 1395 bytes} [Thu Apr 13 15:14:40 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:14:41 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "26419cbf-54b6-47ab-a068-356727e4a6ca"}, {"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-unplugged", "status": "completed", "tag": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2"}, {"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:41 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:41 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:41 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:41 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] Creating event network-vif-plugged:26419cbf-54b6-47ab-a068-356727e4a6ca for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:41 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] Creating event network-vif-unplugged:c6f28318-b210-4a1d-8954-d7e8dc4b19e2 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:41 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] Creating event network-vif-plugged:c6f28318-b210-4a1d-8954-d7e8dc4b19e2 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:41 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.035325 Apr 13 15:14:41 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 145/431] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:41 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:41 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-89fe6cd0-8261-422c-953a-6fdadfcad963 req-f7765923-be5c-4ec4-a955-486878b627d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-plugged", "status": "completed", "tag": "0f04a8c8-b74c-4ecf-9a72-0628b196102c"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:41 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-89fe6cd0-8261-422c-953a-6fdadfcad963 req-f7765923-be5c-4ec4-a955-486878b627d4 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:41 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-89fe6cd0-8261-422c-953a-6fdadfcad963 req-f7765923-be5c-4ec4-a955-486878b627d4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:41 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-89fe6cd0-8261-422c-953a-6fdadfcad963 req-f7765923-be5c-4ec4-a955-486878b627d4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:41 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-89fe6cd0-8261-422c-953a-6fdadfcad963 req-f7765923-be5c-4ec4-a955-486878b627d4 service nova] Creating event network-vif-plugged:0f04a8c8-b74c-4ecf-9a72-0628b196102c for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:41 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-89fe6cd0-8261-422c-953a-6fdadfcad963 req-f7765923-be5c-4ec4-a955-486878b627d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029393 Apr 13 15:14:41 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 146/432] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:41 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-2ef2b7bd-9a2a-43d4-bd0c-282d192ea78a tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] Action: 'create', calling method: .version_select at 0x7f3a8fbf2e60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-714360734", "metadata": {"Type": "work"}}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:41 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-2ef2b7bd-9a2a-43d4-bd0c-282d192ea78a tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] Request method failure captured: Apr 13 15:14:41 user devstack@n-api.service[61871]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 15:14:41 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:14:41 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:14:41 user devstack@n-api.service[61871]: Connection: close Apr 13 15:14:41 user devstack@n-api.service[61871]: Content-Length: 121 Apr 13 15:14:41 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:14:41 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:14:41 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:14:41 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBxhfvj6U156eGN-zyyj_53zADAfX9rWyzJfs9_-_1ZzHd10vOYdQT7ILTpRalhwa3vjQBJqzd1IbAEVEApe8eayLgquT8jW0EmCb9LFHM0HLqIseECQlkDuCWDzBb2Qzkq2JIHLmPBQDCTNozULRWPFPdLPCsSLZo2r3yukTU65qG4 Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Project-Id: 195698762bf54b7e944f118c82ffd9bf Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Project-Name: tempest-VolumesNegativeTest-1019224413 Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/195698762bf54b7e944f118c82ffd9bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/195698762bf54b7e944f118c82ffd9bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/195698762bf54b7e944f118c82ffd9bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Tenant: tempest-VolumesNegativeTest-1019224413 Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Tenant-Id: 195698762bf54b7e944f118c82ffd9bf Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-VolumesNegativeTest-1019224413 Apr 13 15:14:41 user devstack@n-api.service[61871]: X-User: tempest-VolumesNegativeTest-1019224413-project-member Apr 13 15:14:41 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:14:41 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:14:41 user devstack@n-api.service[61871]: X-User-Id: a9616921d46a4e7780315f0db925dcb2 Apr 13 15:14:41 user devstack@n-api.service[61871]: X-User-Name: tempest-VolumesNegativeTest-1019224413-project-member Apr 13 15:14:41 user devstack@n-api.service[61871]: Apr 13 15:14:41 user devstack@n-api.service[61871]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-714360734", "metadata": {"Type": "work"}}} Apr 13 15:14:41 user devstack@n-api.service[61871]: method: Apr 13 15:14:41 user devstack@n-api.service[61871]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 15:14:41 user devstack@n-api.service[61871]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-714360734', 'metadata': {'Type': 'work'}}}} Apr 13 15:14:41 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise error Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi '#$%' Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-2ef2b7bd-9a2a-43d4-bd0c-282d192ea78a tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:14:41 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-2ef2b7bd-9a2a-43d4-bd0c-282d192ea78a tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.186696 Apr 13 15:14:41 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 142/433] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 15:14:41 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:14:41 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-f94b9541-b94d-457e-96a6-dfdd6a51b0d8 tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] Action: 'create', calling method: .version_select at 0x7f3a8fa5d240>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-297224036", "metadata": {"Type": "work"}}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:41 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-f94b9541-b94d-457e-96a6-dfdd6a51b0d8 tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] Request method failure captured: Apr 13 15:14:41 user devstack@n-api.service[61872]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 15:14:41 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:14:41 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:14:41 user devstack@n-api.service[61872]: Connection: close Apr 13 15:14:41 user devstack@n-api.service[61872]: Content-Length: 119 Apr 13 15:14:41 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:14:41 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:14:41 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:14:41 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBxhfvj6U156eGN-zyyj_53zADAfX9rWyzJfs9_-_1ZzHd10vOYdQT7ILTpRalhwa3vjQBJqzd1IbAEVEApe8eayLgquT8jW0EmCb9LFHM0HLqIseECQlkDuCWDzBb2Qzkq2JIHLmPBQDCTNozULRWPFPdLPCsSLZo2r3yukTU65qG4 Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Project-Id: 195698762bf54b7e944f118c82ffd9bf Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Project-Name: tempest-VolumesNegativeTest-1019224413 Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/195698762bf54b7e944f118c82ffd9bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/195698762bf54b7e944f118c82ffd9bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/195698762bf54b7e944f118c82ffd9bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Tenant: tempest-VolumesNegativeTest-1019224413 Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Tenant-Id: 195698762bf54b7e944f118c82ffd9bf Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-VolumesNegativeTest-1019224413 Apr 13 15:14:41 user devstack@n-api.service[61872]: X-User: tempest-VolumesNegativeTest-1019224413-project-member Apr 13 15:14:41 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:14:41 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:14:41 user devstack@n-api.service[61872]: X-User-Id: a9616921d46a4e7780315f0db925dcb2 Apr 13 15:14:41 user devstack@n-api.service[61872]: X-User-Name: tempest-VolumesNegativeTest-1019224413-project-member Apr 13 15:14:41 user devstack@n-api.service[61872]: Apr 13 15:14:41 user devstack@n-api.service[61872]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-297224036", "metadata": {"Type": "work"}}} Apr 13 15:14:41 user devstack@n-api.service[61872]: method: Apr 13 15:14:41 user devstack@n-api.service[61872]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 15:14:41 user devstack@n-api.service[61872]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-297224036', 'metadata': {'Type': 'work'}}}} Apr 13 15:14:41 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise error Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi '0' Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-f94b9541-b94d-457e-96a6-dfdd6a51b0d8 tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:14:41 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-f94b9541-b94d-457e-96a6-dfdd6a51b0d8 tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012681 Apr 13 15:14:41 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 146/434] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 15:14:41 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:14:41 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-e7ffd9b0-b26c-4709-b127-179a39927534 tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] Action: 'create', calling method: .version_select at 0x7f3a8ba02950>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-969579671", "metadata": {"Type": "work"}}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:41 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-e7ffd9b0-b26c-4709-b127-179a39927534 tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] Request method failure captured: Apr 13 15:14:41 user devstack@n-api.service[61873]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 15:14:41 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:14:41 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:14:41 user devstack@n-api.service[61873]: Connection: close Apr 13 15:14:41 user devstack@n-api.service[61873]: Content-Length: 118 Apr 13 15:14:41 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:14:41 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:14:41 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:14:41 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:14:41 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBxhfvj6U156eGN-zyyj_53zADAfX9rWyzJfs9_-_1ZzHd10vOYdQT7ILTpRalhwa3vjQBJqzd1IbAEVEApe8eayLgquT8jW0EmCb9LFHM0HLqIseECQlkDuCWDzBb2Qzkq2JIHLmPBQDCTNozULRWPFPdLPCsSLZo2r3yukTU65qG4 Apr 13 15:14:41 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:14:41 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:14:41 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:14:41 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:14:41 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:14:41 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:14:41 user devstack@n-api.service[61873]: X-Project-Id: 195698762bf54b7e944f118c82ffd9bf Apr 13 15:14:41 user devstack@n-api.service[61873]: X-Project-Name: tempest-VolumesNegativeTest-1019224413 Apr 13 15:14:41 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:14:41 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:14:41 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/195698762bf54b7e944f118c82ffd9bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/195698762bf54b7e944f118c82ffd9bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/195698762bf54b7e944f118c82ffd9bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:14:41 user devstack@n-api.service[61873]: X-Tenant: tempest-VolumesNegativeTest-1019224413 Apr 13 15:14:41 user devstack@n-api.service[61873]: X-Tenant-Id: 195698762bf54b7e944f118c82ffd9bf Apr 13 15:14:41 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-VolumesNegativeTest-1019224413 Apr 13 15:14:41 user devstack@n-api.service[61873]: X-User: tempest-VolumesNegativeTest-1019224413-project-member Apr 13 15:14:41 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:14:41 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:14:41 user devstack@n-api.service[61873]: X-User-Id: a9616921d46a4e7780315f0db925dcb2 Apr 13 15:14:41 user devstack@n-api.service[61873]: X-User-Name: tempest-VolumesNegativeTest-1019224413-project-member Apr 13 15:14:41 user devstack@n-api.service[61873]: Apr 13 15:14:41 user devstack@n-api.service[61873]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-969579671", "metadata": {"Type": "work"}}} Apr 13 15:14:41 user devstack@n-api.service[61873]: method: Apr 13 15:14:41 user devstack@n-api.service[61873]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 15:14:41 user devstack@n-api.service[61873]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-969579671', 'metadata': {'Type': 'work'}}}} Apr 13 15:14:41 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise error Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi '' Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 15:14:41 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-e7ffd9b0-b26c-4709-b127-179a39927534 tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:14:41 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-e7ffd9b0-b26c-4709-b127-179a39927534 tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015779 Apr 13 15:14:41 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 147/435] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 15:14:41 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:14:41 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-da1b4d3f-7866-470f-b677-939e1c9bbcfc tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] Calling method '.version_select at 0x7f3a90887640>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:41 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-da1b4d3f-7866-470f-b677-939e1c9bbcfc tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] HTTP exception thrown: Volume tempest-invalid-1352038686 could not be found. Apr 13 15:14:41 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-da1b4d3f-7866-470f-b677-939e1c9bbcfc tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] Request method failure captured: Apr 13 15:14:41 user devstack@n-api.service[61871]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1352038686 HTTP/1.1 Apr 13 15:14:41 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:14:41 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:14:41 user devstack@n-api.service[61871]: Connection: close Apr 13 15:14:41 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:14:41 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:14:41 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:14:41 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:14:41 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBxhfvj6U156eGN-zyyj_53zADAfX9rWyzJfs9_-_1ZzHd10vOYdQT7ILTpRalhwa3vjQBJqzd1IbAEVEApe8eayLgquT8jW0EmCb9LFHM0HLqIseECQlkDuCWDzBb2Qzkq2JIHLmPBQDCTNozULRWPFPdLPCsSLZo2r3yukTU65qG4 Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Project-Id: 195698762bf54b7e944f118c82ffd9bf Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Project-Name: tempest-VolumesNegativeTest-1019224413 Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/195698762bf54b7e944f118c82ffd9bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/195698762bf54b7e944f118c82ffd9bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/195698762bf54b7e944f118c82ffd9bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Tenant: tempest-VolumesNegativeTest-1019224413 Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Tenant-Id: 195698762bf54b7e944f118c82ffd9bf Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-VolumesNegativeTest-1019224413 Apr 13 15:14:41 user devstack@n-api.service[61871]: X-User: tempest-VolumesNegativeTest-1019224413-project-member Apr 13 15:14:41 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:14:41 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:14:41 user devstack@n-api.service[61871]: X-User-Id: a9616921d46a4e7780315f0db925dcb2 Apr 13 15:14:41 user devstack@n-api.service[61871]: X-User-Name: tempest-VolumesNegativeTest-1019224413-project-member Apr 13 15:14:41 user devstack@n-api.service[61871]: method: Apr 13 15:14:41 user devstack@n-api.service[61871]: exception: Volume tempest-invalid-1352038686 could not be found. Apr 13 15:14:41 user devstack@n-api.service[61871]: action_args: {'id': 'tempest-invalid-1352038686'} Apr 13 15:14:41 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1352038686 could not be found. (HTTP 404) (Request-ID: req-02ec2884-eeca-468a-86d1-7b2968c80a5e) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1352038686 could not be found. Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1352038686 could not be found. Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1352038686 could not be found. Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-da1b4d3f-7866-470f-b677-939e1c9bbcfc tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] Returning 404 to user: Volume tempest-invalid-1352038686 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:14:41 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-da1b4d3f-7866-470f-b677-939e1c9bbcfc tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1352038686" status: 404 len: 99 microversion: 2.1 time: 0.042337 Apr 13 15:14:41 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 143/436] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 15:14:41 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1352038686 => generated 99 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 13 15:14:41 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-8d5868fb-5b1f-45a9-9e02-75086666b656 tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003855 Apr 13 15:14:41 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 147/437] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 13 15:14:41 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 13 15:14:41 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-e0197c8d-54c3-403e-8aad-d827a7a900db tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003954 Apr 13 15:14:41 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 148/438] 10.0.0.210 () {62 vars in 1214 bytes} [Thu Apr 13 15:14:41 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 13 15:14:41 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-bf4d3ad6-21bb-4f15-81c8-6808488137ca tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] Calling method '.version_select at 0x7f3a8f9608b0>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:41 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-bf4d3ad6-21bb-4f15-81c8-6808488137ca tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] HTTP exception thrown: Volume 51752506-9693-42c8-948d-10b07f048ddb could not be found. Apr 13 15:14:41 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-bf4d3ad6-21bb-4f15-81c8-6808488137ca tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] Request method failure captured: Apr 13 15:14:41 user devstack@n-api.service[61871]: request: DELETE /compute/v2.1/os-volumes/51752506-9693-42c8-948d-10b07f048ddb HTTP/1.1 Apr 13 15:14:41 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:14:41 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:14:41 user devstack@n-api.service[61871]: Connection: close Apr 13 15:14:41 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:14:41 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:14:41 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:14:41 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:14:41 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBxhfvj6U156eGN-zyyj_53zADAfX9rWyzJfs9_-_1ZzHd10vOYdQT7ILTpRalhwa3vjQBJqzd1IbAEVEApe8eayLgquT8jW0EmCb9LFHM0HLqIseECQlkDuCWDzBb2Qzkq2JIHLmPBQDCTNozULRWPFPdLPCsSLZo2r3yukTU65qG4 Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Project-Id: 195698762bf54b7e944f118c82ffd9bf Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Project-Name: tempest-VolumesNegativeTest-1019224413 Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/195698762bf54b7e944f118c82ffd9bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/195698762bf54b7e944f118c82ffd9bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/195698762bf54b7e944f118c82ffd9bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Tenant: tempest-VolumesNegativeTest-1019224413 Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Tenant-Id: 195698762bf54b7e944f118c82ffd9bf Apr 13 15:14:41 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-VolumesNegativeTest-1019224413 Apr 13 15:14:41 user devstack@n-api.service[61871]: X-User: tempest-VolumesNegativeTest-1019224413-project-member Apr 13 15:14:41 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:14:41 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:14:41 user devstack@n-api.service[61871]: X-User-Id: a9616921d46a4e7780315f0db925dcb2 Apr 13 15:14:41 user devstack@n-api.service[61871]: X-User-Name: tempest-VolumesNegativeTest-1019224413-project-member Apr 13 15:14:41 user devstack@n-api.service[61871]: method: Apr 13 15:14:41 user devstack@n-api.service[61871]: exception: Volume 51752506-9693-42c8-948d-10b07f048ddb could not be found. Apr 13 15:14:41 user devstack@n-api.service[61871]: action_args: {'id': '51752506-9693-42c8-948d-10b07f048ddb'} Apr 13 15:14:41 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 51752506-9693-42c8-948d-10b07f048ddb could not be found. (HTTP 404) (Request-ID: req-e8b6b381-8cd7-4872-ad9a-1982c7dd2c7c) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 51752506-9693-42c8-948d-10b07f048ddb could not be found. Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 51752506-9693-42c8-948d-10b07f048ddb could not be found. Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 51752506-9693-42c8-948d-10b07f048ddb could not be found. Apr 13 15:14:41 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-bf4d3ad6-21bb-4f15-81c8-6808488137ca tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] Returning 404 to user: Volume 51752506-9693-42c8-948d-10b07f048ddb could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:14:41 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-bf4d3ad6-21bb-4f15-81c8-6808488137ca tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/51752506-9693-42c8-948d-10b07f048ddb" status: 404 len: 109 microversion: 2.1 time: 0.035766 Apr 13 15:14:41 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 144/439] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 15:14:41 2023] DELETE /compute/v2.1/os-volumes/51752506-9693-42c8-948d-10b07f048ddb => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:14:41 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-2e6f08c3-4966-44e7-b8c9-08851e32a7b0 tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] Calling method '.version_select at 0x7f3a8f81e8c0>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:41 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-2e6f08c3-4966-44e7-b8c9-08851e32a7b0 tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] HTTP exception thrown: Volume ae064310-8122-4618-bef0-1d5411a420cd could not be found. Apr 13 15:14:41 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-2e6f08c3-4966-44e7-b8c9-08851e32a7b0 tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] Request method failure captured: Apr 13 15:14:41 user devstack@n-api.service[61872]: request: GET /compute/v2.1/os-volumes/ae064310-8122-4618-bef0-1d5411a420cd HTTP/1.1 Apr 13 15:14:41 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:14:41 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:14:41 user devstack@n-api.service[61872]: Connection: close Apr 13 15:14:41 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:14:41 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:14:41 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:14:41 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:14:41 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBxhfvj6U156eGN-zyyj_53zADAfX9rWyzJfs9_-_1ZzHd10vOYdQT7ILTpRalhwa3vjQBJqzd1IbAEVEApe8eayLgquT8jW0EmCb9LFHM0HLqIseECQlkDuCWDzBb2Qzkq2JIHLmPBQDCTNozULRWPFPdLPCsSLZo2r3yukTU65qG4 Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Project-Id: 195698762bf54b7e944f118c82ffd9bf Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Project-Name: tempest-VolumesNegativeTest-1019224413 Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/195698762bf54b7e944f118c82ffd9bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/195698762bf54b7e944f118c82ffd9bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/195698762bf54b7e944f118c82ffd9bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Tenant: tempest-VolumesNegativeTest-1019224413 Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Tenant-Id: 195698762bf54b7e944f118c82ffd9bf Apr 13 15:14:41 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-VolumesNegativeTest-1019224413 Apr 13 15:14:41 user devstack@n-api.service[61872]: X-User: tempest-VolumesNegativeTest-1019224413-project-member Apr 13 15:14:41 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:14:41 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:14:41 user devstack@n-api.service[61872]: X-User-Id: a9616921d46a4e7780315f0db925dcb2 Apr 13 15:14:41 user devstack@n-api.service[61872]: X-User-Name: tempest-VolumesNegativeTest-1019224413-project-member Apr 13 15:14:41 user devstack@n-api.service[61872]: method: Apr 13 15:14:41 user devstack@n-api.service[61872]: exception: Volume ae064310-8122-4618-bef0-1d5411a420cd could not be found. Apr 13 15:14:41 user devstack@n-api.service[61872]: action_args: {'id': 'ae064310-8122-4618-bef0-1d5411a420cd'} Apr 13 15:14:41 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ae064310-8122-4618-bef0-1d5411a420cd could not be found. (HTTP 404) (Request-ID: req-933f1d9e-9366-4b2c-b137-1854390b457b) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ae064310-8122-4618-bef0-1d5411a420cd could not be found. Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ae064310-8122-4618-bef0-1d5411a420cd could not be found. Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ae064310-8122-4618-bef0-1d5411a420cd could not be found. Apr 13 15:14:41 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:14:41 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-2e6f08c3-4966-44e7-b8c9-08851e32a7b0 tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] Returning 404 to user: Volume ae064310-8122-4618-bef0-1d5411a420cd could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:14:41 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-2e6f08c3-4966-44e7-b8c9-08851e32a7b0 tempest-VolumesNegativeTest-1019224413 tempest-VolumesNegativeTest-1019224413-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ae064310-8122-4618-bef0-1d5411a420cd" status: 404 len: 109 microversion: 2.1 time: 0.036560 Apr 13 15:14:41 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 148/440] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 15:14:41 2023] GET /compute/v2.1/os-volumes/ae064310-8122-4618-bef0-1d5411a420cd => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:14:44 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-e299b543-d1db-47b0-8221-f7509ebb5616 req-dcc6b756-4215-4b17-9379-0f2679807c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-deleted", "tag": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:44 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-e299b543-d1db-47b0-8221-f7509ebb5616 req-dcc6b756-4215-4b17-9379-0f2679807c11 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:44 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-e299b543-d1db-47b0-8221-f7509ebb5616 req-dcc6b756-4215-4b17-9379-0f2679807c11 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:44 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-e299b543-d1db-47b0-8221-f7509ebb5616 req-dcc6b756-4215-4b17-9379-0f2679807c11 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:44 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-e299b543-d1db-47b0-8221-f7509ebb5616 req-dcc6b756-4215-4b17-9379-0f2679807c11 service nova] Creating event network-vif-deleted:c6f28318-b210-4a1d-8954-d7e8dc4b19e2 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:44 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-e299b543-d1db-47b0-8221-f7509ebb5616 req-dcc6b756-4215-4b17-9379-0f2679807c11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043526 Apr 13 15:14:44 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 149/441] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:45 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-9147be38-073b-4582-8597-01d8276b248e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:45 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9147be38-073b-4582-8597-01d8276b248e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:45 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9147be38-073b-4582-8597-01d8276b248e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:45 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9147be38-073b-4582-8597-01d8276b248e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:45 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-9147be38-073b-4582-8597-01d8276b248e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Going to try to stop instance {{(pid=61871) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 13 15:14:45 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-9147be38-073b-4582-8597-01d8276b248e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3/action" status: 202 len: 0 microversion: 2.1 time: 0.112839 Apr 13 15:14:45 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 145/442] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:14:45 2023] POST /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:14:45 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-1a2e949b-12a8-4664-92be-8550ed96d611 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:45 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-1a2e949b-12a8-4664-92be-8550ed96d611 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-1a2e949b-12a8-4664-92be-8550ed96d611 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-1a2e949b-12a8-4664-92be-8550ed96d611 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-1a2e949b-12a8-4664-92be-8550ed96d611 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-1a2e949b-12a8-4664-92be-8550ed96d611 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-1a2e949b-12a8-4664-92be-8550ed96d611 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-1a2e949b-12a8-4664-92be-8550ed96d611 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:45 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-1a2e949b-12a8-4664-92be-8550ed96d611 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1a698b103a47c0b2864eef54be648b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceba33821a9b4f7aa81c2857c11261f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:14:45 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-1a2e949b-12a8-4664-92be-8550ed96d611 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3" status: 200 len: 1710 microversion: 2.1 time: 0.263461 Apr 13 15:14:45 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 149/443] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:14:45 2023] GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3 => generated 1710 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:14:46 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-cc8c2768-0b32-407e-958c-93c913eddf65 req-89193535-0129-4b32-ba6a-6c4a4bd1e51f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-deleted", "tag": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1"}, {"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-deleted", "tag": "0f04a8c8-b74c-4ecf-9a72-0628b196102c"}, {"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-deleted", "tag": "b572fcf6-8374-49f4-b760-dc845d794668"}, {"server_uuid": "241d70af-85a4-4798-9acd-e6431ca5c350", "name": "network-vif-deleted", "tag": "dda3844e-0bda-47ff-8de6-25b9cde47976"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:46 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-cc8c2768-0b32-407e-958c-93c913eddf65 req-89193535-0129-4b32-ba6a-6c4a4bd1e51f service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:46 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-cc8c2768-0b32-407e-958c-93c913eddf65 req-89193535-0129-4b32-ba6a-6c4a4bd1e51f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:46 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-cc8c2768-0b32-407e-958c-93c913eddf65 req-89193535-0129-4b32-ba6a-6c4a4bd1e51f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:46 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-cc8c2768-0b32-407e-958c-93c913eddf65 req-89193535-0129-4b32-ba6a-6c4a4bd1e51f service nova] Creating event network-vif-deleted:5eac5fa3-8589-47e1-8c93-bb65b7b095a1 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:46 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-cc8c2768-0b32-407e-958c-93c913eddf65 req-89193535-0129-4b32-ba6a-6c4a4bd1e51f service nova] Creating event network-vif-deleted:0f04a8c8-b74c-4ecf-9a72-0628b196102c for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:46 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-cc8c2768-0b32-407e-958c-93c913eddf65 req-89193535-0129-4b32-ba6a-6c4a4bd1e51f service nova] Creating event network-vif-deleted:b572fcf6-8374-49f4-b760-dc845d794668 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:46 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-cc8c2768-0b32-407e-958c-93c913eddf65 req-89193535-0129-4b32-ba6a-6c4a4bd1e51f service nova] Creating event network-vif-deleted:dda3844e-0bda-47ff-8de6-25b9cde47976 for instance 241d70af-85a4-4798-9acd-e6431ca5c350 on user Apr 13 15:14:46 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-cc8c2768-0b32-407e-958c-93c913eddf65 req-89193535-0129-4b32-ba6a-6c4a4bd1e51f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.032439 Apr 13 15:14:46 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 150/444] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:46 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:46 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-f2f87653-1f87-4a3a-b66a-927befc96ce7 req-a3529cdd-b9e9-44a6-b20f-1f20e96f79bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa74d14-db6f-41f5-b8af-32da312209d3", "name": "network-vif-unplugged", "status": "completed", "tag": "84611f06-d6ca-49e1-afe7-7723921e62dc"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-f2f87653-1f87-4a3a-b66a-927befc96ce7 req-a3529cdd-b9e9-44a6-b20f-1f20e96f79bd service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-f2f87653-1f87-4a3a-b66a-927befc96ce7 req-a3529cdd-b9e9-44a6-b20f-1f20e96f79bd service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-f2f87653-1f87-4a3a-b66a-927befc96ce7 req-a3529cdd-b9e9-44a6-b20f-1f20e96f79bd service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:46 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-f2f87653-1f87-4a3a-b66a-927befc96ce7 req-a3529cdd-b9e9-44a6-b20f-1f20e96f79bd service nova] Creating event network-vif-unplugged:84611f06-d6ca-49e1-afe7-7723921e62dc for instance 1aa74d14-db6f-41f5-b8af-32da312209d3 on user Apr 13 15:14:46 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-f2f87653-1f87-4a3a-b66a-927befc96ce7 req-a3529cdd-b9e9-44a6-b20f-1f20e96f79bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033045 Apr 13 15:14:46 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 146/445] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:46 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-365e3007-89b0-4662-9afe-591999a50f94 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:46 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-365e3007-89b0-4662-9afe-591999a50f94 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-365e3007-89b0-4662-9afe-591999a50f94 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-365e3007-89b0-4662-9afe-591999a50f94 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-365e3007-89b0-4662-9afe-591999a50f94 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-365e3007-89b0-4662-9afe-591999a50f94 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-365e3007-89b0-4662-9afe-591999a50f94 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-365e3007-89b0-4662-9afe-591999a50f94 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:47 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-365e3007-89b0-4662-9afe-591999a50f94 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041503 Apr 13 15:14:47 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 150/446] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:14:46 2023] GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:14:48 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-67baead5-3751-4c3c-8711-a35db6973b27 req-9edf55bb-2890-4280-8f21-50f9f90e65ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa74d14-db6f-41f5-b8af-32da312209d3", "name": "network-vif-plugged", "status": "completed", "tag": "84611f06-d6ca-49e1-afe7-7723921e62dc"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:48 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-67baead5-3751-4c3c-8711-a35db6973b27 req-9edf55bb-2890-4280-8f21-50f9f90e65ae service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:48 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-67baead5-3751-4c3c-8711-a35db6973b27 req-9edf55bb-2890-4280-8f21-50f9f90e65ae service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:48 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-67baead5-3751-4c3c-8711-a35db6973b27 req-9edf55bb-2890-4280-8f21-50f9f90e65ae service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:48 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-67baead5-3751-4c3c-8711-a35db6973b27 req-9edf55bb-2890-4280-8f21-50f9f90e65ae service nova] Creating event network-vif-plugged:84611f06-d6ca-49e1-afe7-7723921e62dc for instance 1aa74d14-db6f-41f5-b8af-32da312209d3 on user Apr 13 15:14:48 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-67baead5-3751-4c3c-8711-a35db6973b27 req-9edf55bb-2890-4280-8f21-50f9f90e65ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035178 Apr 13 15:14:48 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 151/447] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:49 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-2e04395f-629f-432e-af57-5173285056b3 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Calling method '.version_select at 0x7f3a8faa40d0>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:49 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-2e04395f-629f-432e-af57-5173285056b3 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/b09d887d-e4fc-48c4-a1b4-8c026c0de9fc" status: 204 len: 0 microversion: 2.1 time: 0.229201 Apr 13 15:14:49 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 147/448] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:14:49 2023] DELETE /compute/v2.1/images/b09d887d-e4fc-48c4-a1b4-8c026c0de9fc => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:14:49 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:49 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:49 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Going to try to terminate instance {{(pid=61872) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:14:49 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818" status: 204 len: 0 microversion: 2.1 time: 0.152237 Apr 13 15:14:49 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 151/449] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:14:49 2023] DELETE /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:14:49 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-aea230b3-fc84-489b-b97a-d45e876dd693 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:49 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-aea230b3-fc84-489b-b97a-d45e876dd693 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-aea230b3-fc84-489b-b97a-d45e876dd693 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-aea230b3-fc84-489b-b97a-d45e876dd693 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-aea230b3-fc84-489b-b97a-d45e876dd693 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-aea230b3-fc84-489b-b97a-d45e876dd693 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-aea230b3-fc84-489b-b97a-d45e876dd693 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-aea230b3-fc84-489b-b97a-d45e876dd693 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:49 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-aea230b3-fc84-489b-b97a-d45e876dd693 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30a69b780664742aed58bd9a578e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5acb52755c74d118d012e38feed7237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:14:49 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-aea230b3-fc84-489b-b97a-d45e876dd693 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818" status: 200 len: 1678 microversion: 2.1 time: 0.211406 Apr 13 15:14:49 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 152/450] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:14:49 2023] GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818 => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:14:50 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-49f5b0a8-ae0e-4f6b-bd38-c22149be4f21 req-1f53d2bc-146a-49c7-8770-331e3a45d9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "name": "network-vif-unplugged", "status": "completed", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}, {"server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "name": "network-vif-plugged", "status": "completed", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-49f5b0a8-ae0e-4f6b-bd38-c22149be4f21 req-1f53d2bc-146a-49c7-8770-331e3a45d9d8 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-49f5b0a8-ae0e-4f6b-bd38-c22149be4f21 req-1f53d2bc-146a-49c7-8770-331e3a45d9d8 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-49f5b0a8-ae0e-4f6b-bd38-c22149be4f21 req-1f53d2bc-146a-49c7-8770-331e3a45d9d8 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:50 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-49f5b0a8-ae0e-4f6b-bd38-c22149be4f21 req-1f53d2bc-146a-49c7-8770-331e3a45d9d8 service nova] Creating event network-vif-unplugged:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:14:50 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-49f5b0a8-ae0e-4f6b-bd38-c22149be4f21 req-1f53d2bc-146a-49c7-8770-331e3a45d9d8 service nova] Creating event network-vif-plugged:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:14:50 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-49f5b0a8-ae0e-4f6b-bd38-c22149be4f21 req-1f53d2bc-146a-49c7-8770-331e3a45d9d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031665 Apr 13 15:14:50 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 148/451] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:50 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:51 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-4fd6d627-ab2b-4051-9697-c61fea7a4052 req-d7266237-e2e9-4c0f-949d-8d100328733e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654608ee-5897-429a-b19c-6845d4e84818", "name": "network-vif-deleted", "tag": "a534f901-d679-4443-bf28-aaba09bf631f"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:14:51 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-4fd6d627-ab2b-4051-9697-c61fea7a4052 req-d7266237-e2e9-4c0f-949d-8d100328733e service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:51 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-4fd6d627-ab2b-4051-9697-c61fea7a4052 req-d7266237-e2e9-4c0f-949d-8d100328733e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:51 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-4fd6d627-ab2b-4051-9697-c61fea7a4052 req-d7266237-e2e9-4c0f-949d-8d100328733e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:51 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-4fd6d627-ab2b-4051-9697-c61fea7a4052 req-d7266237-e2e9-4c0f-949d-8d100328733e service nova] Creating event network-vif-deleted:a534f901-d679-4443-bf28-aaba09bf631f for instance 654608ee-5897-429a-b19c-6845d4e84818 on user Apr 13 15:14:51 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-4fd6d627-ab2b-4051-9697-c61fea7a4052 req-d7266237-e2e9-4c0f-949d-8d100328733e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033851 Apr 13 15:14:51 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 152/452] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:14:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:14:53 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-9e5165c6-4686-4b29-9109-094df545fe17 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:14:53 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-9e5165c6-4686-4b29-9109-094df545fe17 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:14:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9e5165c6-4686-4b29-9109-094df545fe17 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9e5165c6-4686-4b29-9109-094df545fe17 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9e5165c6-4686-4b29-9109-094df545fe17 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9e5165c6-4686-4b29-9109-094df545fe17 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:14:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9e5165c6-4686-4b29-9109-094df545fe17 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:14:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9e5165c6-4686-4b29-9109-094df545fe17 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:14:54 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-9e5165c6-4686-4b29-9109-094df545fe17 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:14:54 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-9e5165c6-4686-4b29-9109-094df545fe17 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653" status: 200 len: 1502 microversion: 2.1 time: 0.148954 Apr 13 15:14:54 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 153/453] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:14:53 2023] GET /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653 => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:15:06 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=21 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:15:06 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:15:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-5eb922b8-aa6c-462a-a0ab-f11ecf5b71e6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:15:06 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-5eb922b8-aa6c-462a-a0ab-f11ecf5b71e6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5eb922b8-aa6c-462a-a0ab-f11ecf5b71e6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5eb922b8-aa6c-462a-a0ab-f11ecf5b71e6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5eb922b8-aa6c-462a-a0ab-f11ecf5b71e6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5eb922b8-aa6c-462a-a0ab-f11ecf5b71e6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5eb922b8-aa6c-462a-a0ab-f11ecf5b71e6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5eb922b8-aa6c-462a-a0ab-f11ecf5b71e6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:06 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-5eb922b8-aa6c-462a-a0ab-f11ecf5b71e6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:15:06 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-5eb922b8-aa6c-462a-a0ab-f11ecf5b71e6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:15:06 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-5eb922b8-aa6c-462a-a0ab-f11ecf5b71e6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:15:06 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-5eb922b8-aa6c-462a-a0ab-f11ecf5b71e6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473" status: 200 len: 1768 microversion: 2.87 time: 0.164280 Apr 13 15:15:06 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 149/454] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:15:06 2023] GET /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473 => generated 1768 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:15:08 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:15:08 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:15:08 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-18bb5ae7-f6b6-4a4b-9c15-dc682eb6601e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-173309121"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:15:08 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-18bb5ae7-f6b6-4a4b-9c15-dc682eb6601e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:08 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-18bb5ae7-f6b6-4a4b-9c15-dc682eb6601e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:08 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-18bb5ae7-f6b6-4a4b-9c15-dc682eb6601e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:08 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-18bb5ae7-f6b6-4a4b-9c15-dc682eb6601e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:08 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-18bb5ae7-f6b6-4a4b-9c15-dc682eb6601e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:08 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-18bb5ae7-f6b6-4a4b-9c15-dc682eb6601e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:08 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-18bb5ae7-f6b6-4a4b-9c15-dc682eb6601e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:08 user devstack@n-api.service[61872]: INFO nova.network.security_group_api [None req-18bb5ae7-f6b6-4a4b-9c15-dc682eb6601e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Removing security group a91149c1-17b5-4868-905e-4a008626e985 from port f7bf7380-3c36-4404-8bba-0f64c3fc59a3 Apr 13 15:15:09 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-18bb5ae7-f6b6-4a4b-9c15-dc682eb6601e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "POST /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/action" status: 202 len: 0 microversion: 2.1 time: 0.590152 Apr 13 15:15:09 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 153/455] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:15:08 2023] POST /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:15:09 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-d45dd36b-5fe8-441d-bfff-6231b232a4fc req-fe215183-dbce-4e97-834f-1a3629c42472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff", "tag": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:15:09 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:15:09 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=45 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:15:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d45dd36b-5fe8-441d-bfff-6231b232a4fc req-fe215183-dbce-4e97-834f-1a3629c42472 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d45dd36b-5fe8-441d-bfff-6231b232a4fc req-fe215183-dbce-4e97-834f-1a3629c42472 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d45dd36b-5fe8-441d-bfff-6231b232a4fc req-fe215183-dbce-4e97-834f-1a3629c42472 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:09 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-d45dd36b-5fe8-441d-bfff-6231b232a4fc req-fe215183-dbce-4e97-834f-1a3629c42472 service nova] Creating event network-changed:f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff on user Apr 13 15:15:09 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-d45dd36b-5fe8-441d-bfff-6231b232a4fc req-fe215183-dbce-4e97-834f-1a3629c42472 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033603 Apr 13 15:15:09 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 154/456] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:15:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:15:10 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-ba053b33-31cf-4c36-9a8d-a42a6c7afd82 req-23dbd749-f3a0-40dc-9914-e1fda6385db1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff", "tag": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:15:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ba053b33-31cf-4c36-9a8d-a42a6c7afd82 req-23dbd749-f3a0-40dc-9914-e1fda6385db1 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ba053b33-31cf-4c36-9a8d-a42a6c7afd82 req-23dbd749-f3a0-40dc-9914-e1fda6385db1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ba053b33-31cf-4c36-9a8d-a42a6c7afd82 req-23dbd749-f3a0-40dc-9914-e1fda6385db1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:10 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-ba053b33-31cf-4c36-9a8d-a42a6c7afd82 req-23dbd749-f3a0-40dc-9914-e1fda6385db1 service nova] Creating event network-changed:f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff on user Apr 13 15:15:10 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-ba053b33-31cf-4c36-9a8d-a42a6c7afd82 req-23dbd749-f3a0-40dc-9914-e1fda6385db1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039191 Apr 13 15:15:10 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 150/457] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:15:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:15:10 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:15:10 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:10 user devstack@n-api.service[61872]: DEBUG nova.objects.instance [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lazy-loading 'services' on Instance uuid 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff {{(pid=61872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:15:10 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/os-volume_attachments/f29176ab-5dde-4b23-9e8d-4aee8409dcb0" status: 202 len: 0 microversion: 2.1 time: 0.180696 Apr 13 15:15:10 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 154/458] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:15:10 2023] DELETE /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/os-volume_attachments/f29176ab-5dde-4b23-9e8d-4aee8409dcb0 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:15:10 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-1c8b0776-4a68-4c2b-bc2e-b38559777e6a tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:15:10 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-1c8b0776-4a68-4c2b-bc2e-b38559777e6a tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1c8b0776-4a68-4c2b-bc2e-b38559777e6a tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1c8b0776-4a68-4c2b-bc2e-b38559777e6a tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1c8b0776-4a68-4c2b-bc2e-b38559777e6a tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1c8b0776-4a68-4c2b-bc2e-b38559777e6a tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1c8b0776-4a68-4c2b-bc2e-b38559777e6a tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1c8b0776-4a68-4c2b-bc2e-b38559777e6a tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:10 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-1c8b0776-4a68-4c2b-bc2e-b38559777e6a tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049299 Apr 13 15:15:10 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 155/459] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:15:10 2023] GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:15:18 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-44eb21e6-af44-4cb0-8b97-ada22aeda228 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:15:18 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-44eb21e6-af44-4cb0-8b97-ada22aeda228 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-44eb21e6-af44-4cb0-8b97-ada22aeda228 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-44eb21e6-af44-4cb0-8b97-ada22aeda228 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-44eb21e6-af44-4cb0-8b97-ada22aeda228 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-44eb21e6-af44-4cb0-8b97-ada22aeda228 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-44eb21e6-af44-4cb0-8b97-ada22aeda228 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-44eb21e6-af44-4cb0-8b97-ada22aeda228 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:18 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-44eb21e6-af44-4cb0-8b97-ada22aeda228 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] HTTP exception thrown: Instance 179b6945-589d-402c-a89e-6b8d68725211 could not be found. Apr 13 15:15:18 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-44eb21e6-af44-4cb0-8b97-ada22aeda228 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Request method failure captured: Apr 13 15:15:18 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211 HTTP/1.1 Apr 13 15:15:18 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:15:18 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:15:18 user devstack@n-api.service[61871]: Connection: close Apr 13 15:15:18 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:15:18 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:15:18 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:15:18 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:15:18 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:15:18 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBr3fDSpjIQ1JemOGQGeN5BSnKPqnDRwtjDBkXKKy2GX3fv6TljSIRRgLc65hdL8gaLq8_-_sogNQu0YAf-DgkdGOI_RTo6U9MxT8FH5ifZqGcGHNhHS-i5u7_WP-a0dmZ31zbF3BZd2gk7Q5TOpcfC81jiQGZ6mJZ9h_kzMCanbFJI Apr 13 15:15:18 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:15:18 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:15:18 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:15:18 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:15:18 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:15:18 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:15:18 user devstack@n-api.service[61871]: X-Project-Id: 7227559570b54e92be19d25938523b49 Apr 13 15:15:18 user devstack@n-api.service[61871]: X-Project-Name: tempest-TestShelveInstance-1754998277 Apr 13 15:15:18 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:15:18 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:15:18 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7227559570b54e92be19d25938523b49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7227559570b54e92be19d25938523b49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7227559570b54e92be19d25938523b49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:15:18 user devstack@n-api.service[61871]: X-Tenant: tempest-TestShelveInstance-1754998277 Apr 13 15:15:18 user devstack@n-api.service[61871]: X-Tenant-Id: 7227559570b54e92be19d25938523b49 Apr 13 15:15:18 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-TestShelveInstance-1754998277 Apr 13 15:15:18 user devstack@n-api.service[61871]: X-User: tempest-TestShelveInstance-1754998277-project-member Apr 13 15:15:18 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:15:18 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:15:18 user devstack@n-api.service[61871]: X-User-Id: 2fc0cce3df7540078438186f46ca4621 Apr 13 15:15:18 user devstack@n-api.service[61871]: X-User-Name: tempest-TestShelveInstance-1754998277-project-member Apr 13 15:15:18 user devstack@n-api.service[61871]: method: > Apr 13 15:15:18 user devstack@n-api.service[61871]: exception: Instance 179b6945-589d-402c-a89e-6b8d68725211 could not be found. Apr 13 15:15:18 user devstack@n-api.service[61871]: action_args: {'id': '179b6945-589d-402c-a89e-6b8d68725211'} Apr 13 15:15:18 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179b6945-589d-402c-a89e-6b8d68725211 could not be found. Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179b6945-589d-402c-a89e-6b8d68725211 could not be found. Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179b6945-589d-402c-a89e-6b8d68725211 could not be found. Apr 13 15:15:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:15:18 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-44eb21e6-af44-4cb0-8b97-ada22aeda228 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Returning 404 to user: Instance 179b6945-589d-402c-a89e-6b8d68725211 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:15:18 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-44eb21e6-af44-4cb0-8b97-ada22aeda228 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211" status: 404 len: 111 microversion: 2.1 time: 0.037792 Apr 13 15:15:18 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 151/460] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:15:18 2023] GET /compute/v2.1/servers/179b6945-589d-402c-a89e-6b8d68725211 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:15:19 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-cc7fe5a8-f32c-4c43-9b2c-066413c480f5 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Calling method '.version_select at 0x7f3a8faba8c0>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:15:19 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-cc7fe5a8-f32c-4c43-9b2c-066413c480f5 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-771163491" status: 202 len: 0 microversion: 2.1 time: 0.023135 Apr 13 15:15:19 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 155/461] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 15:15:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-771163491 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:15:23 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:15:23 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=8 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:15:23 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:15:23 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:23 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Going to try to terminate instance {{(pid=61873) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:15:23 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" status: 204 len: 0 microversion: 2.1 time: 0.120871 Apr 13 15:15:23 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 156/462] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:15:23 2023] DELETE /compute/v2.1/servers/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:15:23 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-7ba934dd-3107-4bb5-84bd-3d36c57a3d67 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:15:23 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-7ba934dd-3107-4bb5-84bd-3d36c57a3d67 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7ba934dd-3107-4bb5-84bd-3d36c57a3d67 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7ba934dd-3107-4bb5-84bd-3d36c57a3d67 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7ba934dd-3107-4bb5-84bd-3d36c57a3d67 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7ba934dd-3107-4bb5-84bd-3d36c57a3d67 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7ba934dd-3107-4bb5-84bd-3d36c57a3d67 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7ba934dd-3107-4bb5-84bd-3d36c57a3d67 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:23 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-7ba934dd-3107-4bb5-84bd-3d36c57a3d67 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc942f33ca46c08bb143ed2efeb458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0cae04ab4b4157a7ef786d165789a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:15:23 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-7ba934dd-3107-4bb5-84bd-3d36c57a3d67 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" status: 200 len: 1492 microversion: 2.1 time: 0.323002 Apr 13 15:15:23 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 152/463] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:15:23 2023] GET /compute/v2.1/servers/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae => generated 1492 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:15:23 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-4bec5501-54f5-4bb0-a98f-536dbfcfe956 req-cb8d426b-ee36-4fbe-aa4a-feb5d8f8eb53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae", "name": "network-vif-unplugged", "status": "completed", "tag": "ec148848-53a7-4ed8-8105-7d95722393bc"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:15:23 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:15:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-4bec5501-54f5-4bb0-a98f-536dbfcfe956 req-cb8d426b-ee36-4fbe-aa4a-feb5d8f8eb53 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-4bec5501-54f5-4bb0-a98f-536dbfcfe956 req-cb8d426b-ee36-4fbe-aa4a-feb5d8f8eb53 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-4bec5501-54f5-4bb0-a98f-536dbfcfe956 req-cb8d426b-ee36-4fbe-aa4a-feb5d8f8eb53 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:23 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-4bec5501-54f5-4bb0-a98f-536dbfcfe956 req-cb8d426b-ee36-4fbe-aa4a-feb5d8f8eb53 service nova] Creating event network-vif-unplugged:ec148848-53a7-4ed8-8105-7d95722393bc for instance 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae on user Apr 13 15:15:23 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-4bec5501-54f5-4bb0-a98f-536dbfcfe956 req-cb8d426b-ee36-4fbe-aa4a-feb5d8f8eb53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036192 Apr 13 15:15:23 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 156/464] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:15:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:15:25 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-6059046e-0092-4b64-a61e-e40c192e76a8 req-da15d920-bad0-444c-a0d1-8caf9abcc11b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae", "name": "network-vif-deleted", "tag": "ec148848-53a7-4ed8-8105-7d95722393bc"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:15:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-6059046e-0092-4b64-a61e-e40c192e76a8 req-da15d920-bad0-444c-a0d1-8caf9abcc11b service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-6059046e-0092-4b64-a61e-e40c192e76a8 req-da15d920-bad0-444c-a0d1-8caf9abcc11b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-6059046e-0092-4b64-a61e-e40c192e76a8 req-da15d920-bad0-444c-a0d1-8caf9abcc11b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:25 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-6059046e-0092-4b64-a61e-e40c192e76a8 req-da15d920-bad0-444c-a0d1-8caf9abcc11b service nova] Creating event network-vif-deleted:ec148848-53a7-4ed8-8105-7d95722393bc for instance 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae on user Apr 13 15:15:25 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-6059046e-0092-4b64-a61e-e40c192e76a8 req-da15d920-bad0-444c-a0d1-8caf9abcc11b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028415 Apr 13 15:15:25 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 157/465] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:15:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:15:25 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-ad612b47-ca5c-4e00-9d55-572d82fcd031 req-d000d07e-2279-4558-b41e-c42fb4c69cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae", "name": "network-vif-plugged", "status": "completed", "tag": "ec148848-53a7-4ed8-8105-7d95722393bc"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:15:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ad612b47-ca5c-4e00-9d55-572d82fcd031 req-d000d07e-2279-4558-b41e-c42fb4c69cb0 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ad612b47-ca5c-4e00-9d55-572d82fcd031 req-d000d07e-2279-4558-b41e-c42fb4c69cb0 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ad612b47-ca5c-4e00-9d55-572d82fcd031 req-d000d07e-2279-4558-b41e-c42fb4c69cb0 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:25 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-ad612b47-ca5c-4e00-9d55-572d82fcd031 req-d000d07e-2279-4558-b41e-c42fb4c69cb0 service nova] Creating event network-vif-plugged:ec148848-53a7-4ed8-8105-7d95722393bc for instance 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae on user Apr 13 15:15:25 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-ad612b47-ca5c-4e00-9d55-572d82fcd031 req-d000d07e-2279-4558-b41e-c42fb4c69cb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030363 Apr 13 15:15:25 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 153/466] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:15:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:15:26 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e954e4b0-c3fd-421d-8234-52128e7ee3e4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:15:26 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-e954e4b0-c3fd-421d-8234-52128e7ee3e4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e954e4b0-c3fd-421d-8234-52128e7ee3e4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e954e4b0-c3fd-421d-8234-52128e7ee3e4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e954e4b0-c3fd-421d-8234-52128e7ee3e4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e954e4b0-c3fd-421d-8234-52128e7ee3e4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e954e4b0-c3fd-421d-8234-52128e7ee3e4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e954e4b0-c3fd-421d-8234-52128e7ee3e4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:26 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-e954e4b0-c3fd-421d-8234-52128e7ee3e4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:15:26 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-e954e4b0-c3fd-421d-8234-52128e7ee3e4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1657 microversion: 2.1 time: 0.176906 Apr 13 15:15:26 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 157/467] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:15:26 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1657 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:15:26 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f88a0575-31ac-45a6-a221-4fc8001fd857"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:15:26 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:27 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.617044 Apr 13 15:15:27 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 158/468] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:15:26 2023] POST /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/os-volume_attachments => generated 194 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:15:28 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-92d61a5a-da49-4ae7-b360-db5cebd9f1a0 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:15:28 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-92d61a5a-da49-4ae7-b360-db5cebd9f1a0 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-92d61a5a-da49-4ae7-b360-db5cebd9f1a0 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-92d61a5a-da49-4ae7-b360-db5cebd9f1a0 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-92d61a5a-da49-4ae7-b360-db5cebd9f1a0 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-92d61a5a-da49-4ae7-b360-db5cebd9f1a0 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-92d61a5a-da49-4ae7-b360-db5cebd9f1a0 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-92d61a5a-da49-4ae7-b360-db5cebd9f1a0 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:28 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-92d61a5a-da49-4ae7-b360-db5cebd9f1a0 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] HTTP exception thrown: Instance 241d70af-85a4-4798-9acd-e6431ca5c350 could not be found. Apr 13 15:15:28 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-92d61a5a-da49-4ae7-b360-db5cebd9f1a0 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Request method failure captured: Apr 13 15:15:28 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350 HTTP/1.1 Apr 13 15:15:28 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:15:28 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:15:28 user devstack@n-api.service[61871]: Connection: close Apr 13 15:15:28 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:15:28 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:15:28 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:15:28 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:15:28 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:15:28 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBvSg42_68s2BNnqOkcHBU4iUEgexu4J8LPFz5a9DuFTG_2BXSjhObgEVKYErxOqJgNghloKcrAL-BGNY5LM54mdC7W-tgZyRsHeYAl7aB3A7UmyCnUXh2Gt0VN9xeD-0n3vqChOy-4gRT5cA6kHIjfCTnzfvIToXuQKvMXAKsQaC-o Apr 13 15:15:28 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:15:28 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:15:28 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:15:28 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:15:28 user devstack@n-api.service[61871]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 15:15:28 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:15:28 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:15:28 user devstack@n-api.service[61871]: X-Project-Id: ac94a736e99f4f978f043f2b1b929284 Apr 13 15:15:28 user devstack@n-api.service[61871]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-379148639 Apr 13 15:15:28 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:15:28 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:15:28 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ac94a736e99f4f978f043f2b1b929284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ac94a736e99f4f978f043f2b1b929284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ac94a736e99f4f978f043f2b1b929284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:15:28 user devstack@n-api.service[61871]: X-Tenant: tempest-TaggedBootDevicesTest_v242-379148639 Apr 13 15:15:28 user devstack@n-api.service[61871]: X-Tenant-Id: ac94a736e99f4f978f043f2b1b929284 Apr 13 15:15:28 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-379148639 Apr 13 15:15:28 user devstack@n-api.service[61871]: X-User: tempest-TaggedBootDevicesTest_v242-379148639-project-member Apr 13 15:15:28 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:15:28 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:15:28 user devstack@n-api.service[61871]: X-User-Id: 9dc549309fa74c0a8eb2f44e5959ce92 Apr 13 15:15:28 user devstack@n-api.service[61871]: X-User-Name: tempest-TaggedBootDevicesTest_v242-379148639-project-member Apr 13 15:15:28 user devstack@n-api.service[61871]: method: > Apr 13 15:15:28 user devstack@n-api.service[61871]: exception: Instance 241d70af-85a4-4798-9acd-e6431ca5c350 could not be found. Apr 13 15:15:28 user devstack@n-api.service[61871]: action_args: {'id': '241d70af-85a4-4798-9acd-e6431ca5c350'} Apr 13 15:15:28 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 241d70af-85a4-4798-9acd-e6431ca5c350 could not be found. Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 241d70af-85a4-4798-9acd-e6431ca5c350 could not be found. Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 241d70af-85a4-4798-9acd-e6431ca5c350 could not be found. Apr 13 15:15:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:15:28 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-92d61a5a-da49-4ae7-b360-db5cebd9f1a0 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Returning 404 to user: Instance 241d70af-85a4-4798-9acd-e6431ca5c350 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:15:28 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-92d61a5a-da49-4ae7-b360-db5cebd9f1a0 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350" status: 404 len: 111 microversion: 2.42 time: 0.036355 Apr 13 15:15:28 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 154/469] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:15:28 2023] GET /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:15:28 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e37100e4-53fe-4562-9535-af58766a050e tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Calling method '.version_select at 0x7f3a8fa5f2e0>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:15:29 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-e37100e4-53fe-4562-9535-af58766a050e tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-251315304" status: 204 len: 0 microversion: 2.42 time: 0.029317 Apr 13 15:15:29 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 158/470] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 13 15:15:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-251315304 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 15:15:32 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-e844fd27-176f-4ff8-bcb6-2769d573b17f tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:15:32 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-e844fd27-176f-4ff8-bcb6-2769d573b17f tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e844fd27-176f-4ff8-bcb6-2769d573b17f tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e844fd27-176f-4ff8-bcb6-2769d573b17f tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e844fd27-176f-4ff8-bcb6-2769d573b17f tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e844fd27-176f-4ff8-bcb6-2769d573b17f tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e844fd27-176f-4ff8-bcb6-2769d573b17f tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e844fd27-176f-4ff8-bcb6-2769d573b17f tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:32 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-e844fd27-176f-4ff8-bcb6-2769d573b17f tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] HTTP exception thrown: Instance 241d70af-85a4-4798-9acd-e6431ca5c350 could not be found. Apr 13 15:15:32 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-e844fd27-176f-4ff8-bcb6-2769d573b17f tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Request method failure captured: Apr 13 15:15:32 user devstack@n-api.service[61873]: request: DELETE /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350 HTTP/1.1 Apr 13 15:15:32 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:15:32 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:15:32 user devstack@n-api.service[61873]: Connection: close Apr 13 15:15:32 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:15:32 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:15:32 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:15:32 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:15:32 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:15:32 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBvSg42_68s2BNnqOkcHBU4iUEgexu4J8LPFz5a9DuFTG_2BXSjhObgEVKYErxOqJgNghloKcrAL-BGNY5LM54mdC7W-tgZyRsHeYAl7aB3A7UmyCnUXh2Gt0VN9xeD-0n3vqChOy-4gRT5cA6kHIjfCTnzfvIToXuQKvMXAKsQaC-o Apr 13 15:15:32 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:15:32 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:15:32 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:15:32 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:15:32 user devstack@n-api.service[61873]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 15:15:32 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:15:32 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:15:32 user devstack@n-api.service[61873]: X-Project-Id: ac94a736e99f4f978f043f2b1b929284 Apr 13 15:15:32 user devstack@n-api.service[61873]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-379148639 Apr 13 15:15:32 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:15:32 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:15:32 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ac94a736e99f4f978f043f2b1b929284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ac94a736e99f4f978f043f2b1b929284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ac94a736e99f4f978f043f2b1b929284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:15:32 user devstack@n-api.service[61873]: X-Tenant: tempest-TaggedBootDevicesTest_v242-379148639 Apr 13 15:15:32 user devstack@n-api.service[61873]: X-Tenant-Id: ac94a736e99f4f978f043f2b1b929284 Apr 13 15:15:32 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-379148639 Apr 13 15:15:32 user devstack@n-api.service[61873]: X-User: tempest-TaggedBootDevicesTest_v242-379148639-project-member Apr 13 15:15:32 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:15:32 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:15:32 user devstack@n-api.service[61873]: X-User-Id: 9dc549309fa74c0a8eb2f44e5959ce92 Apr 13 15:15:32 user devstack@n-api.service[61873]: X-User-Name: tempest-TaggedBootDevicesTest_v242-379148639-project-member Apr 13 15:15:32 user devstack@n-api.service[61873]: method: > Apr 13 15:15:32 user devstack@n-api.service[61873]: exception: Instance 241d70af-85a4-4798-9acd-e6431ca5c350 could not be found. Apr 13 15:15:32 user devstack@n-api.service[61873]: action_args: {'id': '241d70af-85a4-4798-9acd-e6431ca5c350'} Apr 13 15:15:32 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 241d70af-85a4-4798-9acd-e6431ca5c350 could not be found. Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 241d70af-85a4-4798-9acd-e6431ca5c350 could not be found. Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 241d70af-85a4-4798-9acd-e6431ca5c350 could not be found. Apr 13 15:15:32 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:15:32 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-e844fd27-176f-4ff8-bcb6-2769d573b17f tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Returning 404 to user: Instance 241d70af-85a4-4798-9acd-e6431ca5c350 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:15:32 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-e844fd27-176f-4ff8-bcb6-2769d573b17f tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350" status: 404 len: 111 microversion: 2.42 time: 0.044564 Apr 13 15:15:32 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 159/471] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 15:15:32 2023] DELETE /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:15:32 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-db67c451-fe62-4b2b-bdcb-620178c26d0a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:15:32 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-db67c451-fe62-4b2b-bdcb-620178c26d0a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-db67c451-fe62-4b2b-bdcb-620178c26d0a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-db67c451-fe62-4b2b-bdcb-620178c26d0a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-db67c451-fe62-4b2b-bdcb-620178c26d0a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-db67c451-fe62-4b2b-bdcb-620178c26d0a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-db67c451-fe62-4b2b-bdcb-620178c26d0a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-db67c451-fe62-4b2b-bdcb-620178c26d0a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:32 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-db67c451-fe62-4b2b-bdcb-620178c26d0a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] HTTP exception thrown: Instance 241d70af-85a4-4798-9acd-e6431ca5c350 could not be found. Apr 13 15:15:32 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-db67c451-fe62-4b2b-bdcb-620178c26d0a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Request method failure captured: Apr 13 15:15:32 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350 HTTP/1.1 Apr 13 15:15:32 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:15:32 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:15:32 user devstack@n-api.service[61871]: Connection: close Apr 13 15:15:32 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:15:32 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:15:32 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:15:32 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:15:32 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:15:32 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBvSg42_68s2BNnqOkcHBU4iUEgexu4J8LPFz5a9DuFTG_2BXSjhObgEVKYErxOqJgNghloKcrAL-BGNY5LM54mdC7W-tgZyRsHeYAl7aB3A7UmyCnUXh2Gt0VN9xeD-0n3vqChOy-4gRT5cA6kHIjfCTnzfvIToXuQKvMXAKsQaC-o Apr 13 15:15:32 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:15:32 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:15:32 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:15:32 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:15:32 user devstack@n-api.service[61871]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 15:15:32 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:15:32 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:15:32 user devstack@n-api.service[61871]: X-Project-Id: ac94a736e99f4f978f043f2b1b929284 Apr 13 15:15:32 user devstack@n-api.service[61871]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-379148639 Apr 13 15:15:32 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:15:32 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:15:32 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ac94a736e99f4f978f043f2b1b929284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ac94a736e99f4f978f043f2b1b929284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ac94a736e99f4f978f043f2b1b929284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:15:32 user devstack@n-api.service[61871]: X-Tenant: tempest-TaggedBootDevicesTest_v242-379148639 Apr 13 15:15:32 user devstack@n-api.service[61871]: X-Tenant-Id: ac94a736e99f4f978f043f2b1b929284 Apr 13 15:15:32 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-379148639 Apr 13 15:15:32 user devstack@n-api.service[61871]: X-User: tempest-TaggedBootDevicesTest_v242-379148639-project-member Apr 13 15:15:32 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:15:32 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:15:32 user devstack@n-api.service[61871]: X-User-Id: 9dc549309fa74c0a8eb2f44e5959ce92 Apr 13 15:15:32 user devstack@n-api.service[61871]: X-User-Name: tempest-TaggedBootDevicesTest_v242-379148639-project-member Apr 13 15:15:32 user devstack@n-api.service[61871]: method: > Apr 13 15:15:32 user devstack@n-api.service[61871]: exception: Instance 241d70af-85a4-4798-9acd-e6431ca5c350 could not be found. Apr 13 15:15:32 user devstack@n-api.service[61871]: action_args: {'id': '241d70af-85a4-4798-9acd-e6431ca5c350'} Apr 13 15:15:32 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 241d70af-85a4-4798-9acd-e6431ca5c350 could not be found. Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 241d70af-85a4-4798-9acd-e6431ca5c350 could not be found. Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 241d70af-85a4-4798-9acd-e6431ca5c350 could not be found. Apr 13 15:15:32 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:15:32 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-db67c451-fe62-4b2b-bdcb-620178c26d0a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Returning 404 to user: Instance 241d70af-85a4-4798-9acd-e6431ca5c350 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:15:32 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-db67c451-fe62-4b2b-bdcb-620178c26d0a tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350" status: 404 len: 111 microversion: 2.42 time: 0.029570 Apr 13 15:15:32 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 155/472] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:15:32 2023] GET /compute/v2.1/servers/241d70af-85a4-4798-9acd-e6431ca5c350 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:15:35 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-6f973071-f08f-4804-87b4-d004567539e1 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:15:35 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-6f973071-f08f-4804-87b4-d004567539e1 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6f973071-f08f-4804-87b4-d004567539e1 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6f973071-f08f-4804-87b4-d004567539e1 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6f973071-f08f-4804-87b4-d004567539e1 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6f973071-f08f-4804-87b4-d004567539e1 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6f973071-f08f-4804-87b4-d004567539e1 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6f973071-f08f-4804-87b4-d004567539e1 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:35 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-6f973071-f08f-4804-87b4-d004567539e1 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:15:35 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-6f973071-f08f-4804-87b4-d004567539e1 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1703 microversion: 2.1 time: 0.176679 Apr 13 15:15:35 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 159/473] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:15:35 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1703 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-2112327637", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting quotas for project 9154e4239a1a42a3820c27563ba0513f. Resources: dict_keys(['metadata_items']) {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting quotas for user 3c12c62d4137473596571e523163e718 and project 9154e4239a1a42a3820c27563ba0513f. Resources: dict_keys(['metadata_items']) {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:35 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/action" status: 202 len: 1159 microversion: 2.1 time: 0.378574 Apr 13 15:15:35 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 160/474] 10.0.0.210 () {64 vars in 1356 bytes} [Thu Apr 13 15:15:35 2023] POST /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/action => generated 1159 bytes in 381 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 13 15:15:35 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-05d4451c-02f1-41f3-a693-29105fa94ed5 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:15:35 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-05d4451c-02f1-41f3-a693-29105fa94ed5 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-05d4451c-02f1-41f3-a693-29105fa94ed5 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-05d4451c-02f1-41f3-a693-29105fa94ed5 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-05d4451c-02f1-41f3-a693-29105fa94ed5 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-05d4451c-02f1-41f3-a693-29105fa94ed5 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-05d4451c-02f1-41f3-a693-29105fa94ed5 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-05d4451c-02f1-41f3-a693-29105fa94ed5 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:35 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-05d4451c-02f1-41f3-a693-29105fa94ed5 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:15:35 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-05d4451c-02f1-41f3-a693-29105fa94ed5 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1731 microversion: 2.1 time: 0.213363 Apr 13 15:15:35 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 156/475] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:15:35 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1731 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:15:35 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-70dab4dd-bed6-4c6a-bab2-5bb614e0a9af tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:15:35 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-70dab4dd-bed6-4c6a-bab2-5bb614e0a9af tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-70dab4dd-bed6-4c6a-bab2-5bb614e0a9af tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-70dab4dd-bed6-4c6a-bab2-5bb614e0a9af tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-70dab4dd-bed6-4c6a-bab2-5bb614e0a9af tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-70dab4dd-bed6-4c6a-bab2-5bb614e0a9af tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-70dab4dd-bed6-4c6a-bab2-5bb614e0a9af tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-70dab4dd-bed6-4c6a-bab2-5bb614e0a9af tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:36 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-70dab4dd-bed6-4c6a-bab2-5bb614e0a9af tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1a698b103a47c0b2864eef54be648b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceba33821a9b4f7aa81c2857c11261f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:15:36 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-70dab4dd-bed6-4c6a-bab2-5bb614e0a9af tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3" status: 200 len: 1687 microversion: 2.1 time: 0.162585 Apr 13 15:15:36 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 160/476] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:15:35 2023] GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:15:36 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-a572e42d-75cb-4099-a2e7-91528cb86e1c req-a68c609f-e948-4445-8c66-eb0c21562d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b5bd-5f78-448e-bd82-74b2263dff75", "name": "network-vif-unplugged", "status": "completed", "tag": "9c8ad360-aa62-4ef1-952f-d73f885baa89"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:15:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-a572e42d-75cb-4099-a2e7-91528cb86e1c req-a68c609f-e948-4445-8c66-eb0c21562d3e service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-a572e42d-75cb-4099-a2e7-91528cb86e1c req-a68c609f-e948-4445-8c66-eb0c21562d3e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-a572e42d-75cb-4099-a2e7-91528cb86e1c req-a68c609f-e948-4445-8c66-eb0c21562d3e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:36 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-a572e42d-75cb-4099-a2e7-91528cb86e1c req-a68c609f-e948-4445-8c66-eb0c21562d3e service nova] Creating event network-vif-unplugged:9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 on user Apr 13 15:15:36 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-a572e42d-75cb-4099-a2e7-91528cb86e1c req-a68c609f-e948-4445-8c66-eb0c21562d3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032489 Apr 13 15:15:36 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 161/477] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:15:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:15:38 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-7735f7d0-ea81-42be-ab25-388faf6ead5e req-2c271124-b7a8-430d-99bd-297ed0557c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b5bd-5f78-448e-bd82-74b2263dff75", "name": "network-vif-plugged", "status": "completed", "tag": "9c8ad360-aa62-4ef1-952f-d73f885baa89"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:15:38 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=19 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:15:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-7735f7d0-ea81-42be-ab25-388faf6ead5e req-2c271124-b7a8-430d-99bd-297ed0557c58 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-7735f7d0-ea81-42be-ab25-388faf6ead5e req-2c271124-b7a8-430d-99bd-297ed0557c58 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-7735f7d0-ea81-42be-ab25-388faf6ead5e req-2c271124-b7a8-430d-99bd-297ed0557c58 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:38 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=29 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:15:38 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-7735f7d0-ea81-42be-ab25-388faf6ead5e req-2c271124-b7a8-430d-99bd-297ed0557c58 service nova] Creating event network-vif-plugged:9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 on user Apr 13 15:15:38 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-7735f7d0-ea81-42be-ab25-388faf6ead5e req-2c271124-b7a8-430d-99bd-297ed0557c58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033784 Apr 13 15:15:38 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 157/478] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:15:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:15:39 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-68e1f83c-e8e2-4647-b569-6c696b854821 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:15:39 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-68e1f83c-e8e2-4647-b569-6c696b854821 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:39 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:15:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-68e1f83c-e8e2-4647-b569-6c696b854821 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-68e1f83c-e8e2-4647-b569-6c696b854821 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-68e1f83c-e8e2-4647-b569-6c696b854821 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-68e1f83c-e8e2-4647-b569-6c696b854821 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-68e1f83c-e8e2-4647-b569-6c696b854821 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-68e1f83c-e8e2-4647-b569-6c696b854821 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:39 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-68e1f83c-e8e2-4647-b569-6c696b854821 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] HTTP exception thrown: Instance 654608ee-5897-429a-b19c-6845d4e84818 could not be found. Apr 13 15:15:39 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-68e1f83c-e8e2-4647-b569-6c696b854821 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Request method failure captured: Apr 13 15:15:39 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818 HTTP/1.1 Apr 13 15:15:39 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:15:39 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:15:39 user devstack@n-api.service[61872]: Connection: close Apr 13 15:15:39 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:15:39 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:15:39 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:15:39 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:15:39 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:15:39 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBqwYyG2ERklMxFMjlMlxNHkF82XmWGUpXCNY7MWU_LoQ-ubm5sCMtL0ArrSPe6kBFcaohzdEEHaA9iHYf24CRzYjPasU0sxR2gmVA6lBB824Y0BEcb3hZdpH7JU3xV_WgSrK4zblSyEUG9tDCnfh5LvUXboDfbSxtFZ5R0kLHAMBL0 Apr 13 15:15:39 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:15:39 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:15:39 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:15:39 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:15:39 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:15:39 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:15:39 user devstack@n-api.service[61872]: X-Project-Id: b5acb52755c74d118d012e38feed7237 Apr 13 15:15:39 user devstack@n-api.service[61872]: X-Project-Name: tempest-ServerStableDeviceRescueTest-147407416 Apr 13 15:15:39 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:15:39 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:15:39 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b5acb52755c74d118d012e38feed7237"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b5acb52755c74d118d012e38feed7237"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b5acb52755c74d118d012e38feed7237"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:15:39 user devstack@n-api.service[61872]: X-Tenant: tempest-ServerStableDeviceRescueTest-147407416 Apr 13 15:15:39 user devstack@n-api.service[61872]: X-Tenant-Id: b5acb52755c74d118d012e38feed7237 Apr 13 15:15:39 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-147407416 Apr 13 15:15:39 user devstack@n-api.service[61872]: X-User: tempest-ServerStableDeviceRescueTest-147407416-project-member Apr 13 15:15:39 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:15:39 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:15:39 user devstack@n-api.service[61872]: X-User-Id: b30a69b780664742aed58bd9a578e873 Apr 13 15:15:39 user devstack@n-api.service[61872]: X-User-Name: tempest-ServerStableDeviceRescueTest-147407416-project-member Apr 13 15:15:39 user devstack@n-api.service[61872]: method: > Apr 13 15:15:39 user devstack@n-api.service[61872]: exception: Instance 654608ee-5897-429a-b19c-6845d4e84818 could not be found. Apr 13 15:15:39 user devstack@n-api.service[61872]: action_args: {'id': '654608ee-5897-429a-b19c-6845d4e84818'} Apr 13 15:15:39 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 654608ee-5897-429a-b19c-6845d4e84818 could not be found. Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 654608ee-5897-429a-b19c-6845d4e84818 could not be found. Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 654608ee-5897-429a-b19c-6845d4e84818 could not be found. Apr 13 15:15:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:15:39 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-68e1f83c-e8e2-4647-b569-6c696b854821 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Returning 404 to user: Instance 654608ee-5897-429a-b19c-6845d4e84818 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:15:39 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-68e1f83c-e8e2-4647-b569-6c696b854821 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818" status: 404 len: 111 microversion: 2.1 time: 0.030177 Apr 13 15:15:39 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 161/479] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:15:39 2023] GET /compute/v2.1/servers/654608ee-5897-429a-b19c-6845d4e84818 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:15:40 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-0536e890-112f-4e81-b58d-e2cfdb5716b6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Calling method '.version_select at 0x7f3a8badcca0>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:15:40 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-0536e890-112f-4e81-b58d-e2cfdb5716b6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-135051856" status: 202 len: 0 microversion: 2.1 time: 0.031915 Apr 13 15:15:40 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 162/480] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 15:15:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-135051856 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 15:15:46 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-ae17e5c1-644a-4efb-8294-11738cf3c535 req-3588a003-9622-43a9-bcc3-99be20ce581b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b5bd-5f78-448e-bd82-74b2263dff75", "name": "network-vif-plugged", "status": "completed", "tag": "9c8ad360-aa62-4ef1-952f-d73f885baa89"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:15:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ae17e5c1-644a-4efb-8294-11738cf3c535 req-3588a003-9622-43a9-bcc3-99be20ce581b service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ae17e5c1-644a-4efb-8294-11738cf3c535 req-3588a003-9622-43a9-bcc3-99be20ce581b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ae17e5c1-644a-4efb-8294-11738cf3c535 req-3588a003-9622-43a9-bcc3-99be20ce581b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:46 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-ae17e5c1-644a-4efb-8294-11738cf3c535 req-3588a003-9622-43a9-bcc3-99be20ce581b service nova] Creating event network-vif-plugged:9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 on user Apr 13 15:15:46 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-ae17e5c1-644a-4efb-8294-11738cf3c535 req-3588a003-9622-43a9-bcc3-99be20ce581b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059118 Apr 13 15:15:46 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 158/481] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:15:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:15:48 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-7fd6f160-749e-4819-8df4-3bc57d7a5700 req-f17ec27e-e931-4558-b105-759767a586c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b5bd-5f78-448e-bd82-74b2263dff75", "name": "network-vif-plugged", "status": "completed", "tag": "9c8ad360-aa62-4ef1-952f-d73f885baa89"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:15:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-7fd6f160-749e-4819-8df4-3bc57d7a5700 req-f17ec27e-e931-4558-b105-759767a586c1 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-7fd6f160-749e-4819-8df4-3bc57d7a5700 req-f17ec27e-e931-4558-b105-759767a586c1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-7fd6f160-749e-4819-8df4-3bc57d7a5700 req-f17ec27e-e931-4558-b105-759767a586c1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:49 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-7fd6f160-749e-4819-8df4-3bc57d7a5700 req-f17ec27e-e931-4558-b105-759767a586c1 service nova] Creating event network-vif-plugged:9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 on user Apr 13 15:15:49 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-7fd6f160-749e-4819-8df4-3bc57d7a5700 req-f17ec27e-e931-4558-b105-759767a586c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037337 Apr 13 15:15:49 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 162/482] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:15:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:15:56 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=8,nova_cell1:INSERT=4,nova_cell1:DELETE=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:15:56 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:15:56 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-b6f0b0b8-1e9e-4853-9a47-c8a1bf5c8b03 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Action: 'create', calling method: .version_select at 0x7f3a8badf6d0>, body: {"keypair": {"name": "tempest-keypair-1984106079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJYk9tq5AvbxsFkvXz5FVdGRka7rNiMF6WvvCvJVSoNv884hYwfP0GXu7pHHmy35RfD0O62LDgQO/pA3hHgZ02L7AhEcCLbnl0u1GsjlLAH6Mo68d+qkyG5GIOBX6RHAA=="}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:15:56 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-b6f0b0b8-1e9e-4853-9a47-c8a1bf5c8b03 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting quotas for project 3e3ba2d132c445039d0ae30ffd2bc64a. Resources: {'key_pairs'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:15:56 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-b6f0b0b8-1e9e-4853-9a47-c8a1bf5c8b03 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting quotas for user fedd34ccc15c47f9a4fc96b080730acd and project 3e3ba2d132c445039d0ae30ffd2bc64a. Resources: {'key_pairs'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:15:56 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-b6f0b0b8-1e9e-4853-9a47-c8a1bf5c8b03 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.177976 Apr 13 15:15:56 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 163/483] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 15:15:56 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:15:56 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-f318c9df-00c1-4705-a08d-5d774cfb45b4 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Action: 'create', calling method: .version_select at 0x7f3a8f960700>, body: {"keypair": {"name": "tempest-keypair-1516441123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMK5IRXy1iREs5DJGXQd5/AwCvP1NHbH7B+ioRYx7R5/k6QdMWuWbYssq6+iYLG0++tDjS55HcQeDhgUv/EqHbP9wKGTtL2gyMe13XKrxk7Yzy8UBwjPqj14R6xUkbKGdQ=="}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:15:56 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-f318c9df-00c1-4705-a08d-5d774cfb45b4 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Getting quotas for project 9bad96fcfa0d4691af2a7990ba9dbd09. Resources: {'key_pairs'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:15:56 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-f318c9df-00c1-4705-a08d-5d774cfb45b4 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Getting quotas for user c83940ddaaf64d94b40df9d00349aa91 and project 9bad96fcfa0d4691af2a7990ba9dbd09. Resources: {'key_pairs'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:15:56 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-f318c9df-00c1-4705-a08d-5d774cfb45b4 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066839 Apr 13 15:15:56 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 159/484] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 15:15:56 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:15:58 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1194728092", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "434a74f0-0d97-44db-bbc8-2c5b3599caab"}], "security_groups": [{"name": "tempest-securitygroup--614678030"}], "key_name": "tempest-keypair-1516441123", "user_data": "}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:15:58 user devstack@n-api.service[61872]: DEBUG nova.network.neutron [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] validate_networks() for [('434a74f0-0d97-44db-bbc8-2c5b3599caab', None, None, None, None, None)] {{(pid=61872) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:15:58 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1109825086", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "547bb22a-22b3-4b8b-ab87-e4eb4af27619"}], "security_groups": [{"name": "tempest-securitygroup--351253382"}], "key_name": "tempest-keypair-1984106079", "user_data": "}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:15:58 user devstack@n-api.service[61873]: DEBUG nova.network.neutron [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] validate_networks() for [('547bb22a-22b3-4b8b-ab87-e4eb4af27619', None, None, None, None, None)] {{(pid=61873) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:15:58 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Flavor limits 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:15:58 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Image limits 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:15:58 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Flavor pref 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:15:58 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Image pref 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:15:58 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:15:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:58 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=25 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:15:58 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Getting quotas for project 9bad96fcfa0d4691af2a7990ba9dbd09. Resources: {'cores', 'instances', 'ram'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:15:58 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Getting quotas for user c83940ddaaf64d94b40df9d00349aa91 and project 9bad96fcfa0d4691af2a7990ba9dbd09. Resources: {'cores', 'instances', 'ram'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:15:58 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Going to run 1 instances... {{(pid=61872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:15:59 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:15:59 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.768230 Apr 13 15:15:59 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 163/485] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:15:58 2023] POST /compute/v2.1/servers => generated 406 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:15:59 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:15:59 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-9c40517d-20b8-4720-91a8-216355e2dd9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:15:59 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-9c40517d-20b8-4720-91a8-216355e2dd9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:59 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-9c40517d-20b8-4720-91a8-216355e2dd9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:15:59 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-9c40517d-20b8-4720-91a8-216355e2dd9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e" status: 200 len: 1240 microversion: 2.1 time: 0.098442 Apr 13 15:15:59 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 160/486] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:15:59 2023] GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e => generated 1240 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:15:59 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Flavor limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:15:59 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Image limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:15:59 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Flavor pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:15:59 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Image pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:15:59 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:15:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:15:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:15:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:15:59 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting quotas for project 3e3ba2d132c445039d0ae30ffd2bc64a. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:15:59 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting quotas for user fedd34ccc15c47f9a4fc96b080730acd and project 3e3ba2d132c445039d0ae30ffd2bc64a. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:15:59 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Going to run 1 instances... {{(pid=61873) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:15:59 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:15:59 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.814614 Apr 13 15:15:59 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 164/487] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:15:58 2023] POST /compute/v2.1/servers => generated 399 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:15:59 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-adfa9c4c-88b4-453a-b7bb-c332b14f903c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:15:59 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-adfa9c4c-88b4-453a-b7bb-c332b14f903c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:15:59 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-adfa9c4c-88b4-453a-b7bb-c332b14f903c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedd34ccc15c47f9a4fc96b080730acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3ba2d132c445039d0ae30ffd2bc64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:15:59 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-adfa9c4c-88b4-453a-b7bb-c332b14f903c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162" status: 200 len: 1236 microversion: 2.1 time: 0.077803 Apr 13 15:15:59 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 164/488] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:15:59 2023] GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162 => generated 1236 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:16:00 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-6497b135-f8c0-4f92-9ce8-1cd6b9e12711 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:16:00 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-6497b135-f8c0-4f92-9ce8-1cd6b9e12711 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:16:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6497b135-f8c0-4f92-9ce8-1cd6b9e12711 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6497b135-f8c0-4f92-9ce8-1cd6b9e12711 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6497b135-f8c0-4f92-9ce8-1cd6b9e12711 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6497b135-f8c0-4f92-9ce8-1cd6b9e12711 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6497b135-f8c0-4f92-9ce8-1cd6b9e12711 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6497b135-f8c0-4f92-9ce8-1cd6b9e12711 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:00 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-6497b135-f8c0-4f92-9ce8-1cd6b9e12711 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066048 Apr 13 15:16:00 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 161/489] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:16:00 2023] GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:16:00 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-2e919a2b-671e-4ce7-99d9-7696ae5212c2 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:16:00 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-2e919a2b-671e-4ce7-99d9-7696ae5212c2 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:16:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2e919a2b-671e-4ce7-99d9-7696ae5212c2 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2e919a2b-671e-4ce7-99d9-7696ae5212c2 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2e919a2b-671e-4ce7-99d9-7696ae5212c2 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2e919a2b-671e-4ce7-99d9-7696ae5212c2 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2e919a2b-671e-4ce7-99d9-7696ae5212c2 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2e919a2b-671e-4ce7-99d9-7696ae5212c2 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:00 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-2e919a2b-671e-4ce7-99d9-7696ae5212c2 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] HTTP exception thrown: Instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff is not attached to volume f29176ab-5dde-4b23-9e8d-4aee8409dcb0 Apr 13 15:16:00 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-2e919a2b-671e-4ce7-99d9-7696ae5212c2 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Request method failure captured: Apr 13 15:16:00 user devstack@n-api.service[61873]: request: DELETE /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/os-volume_attachments/f29176ab-5dde-4b23-9e8d-4aee8409dcb0 HTTP/1.1 Apr 13 15:16:00 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:16:00 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:16:00 user devstack@n-api.service[61873]: Connection: close Apr 13 15:16:00 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:16:00 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:16:00 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:16:00 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:16:00 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:16:00 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBt_gL21F_HIzMNmMeHvCDxve6FeNon6Vk99gIHKSfsweejUx9M3I34NpTA5cEP08XCf4a9uHtu9GTiU0WZa1B6p4O_X0BvfGoqlTBj9g-4Mh1KzprzD4zd4ps5-GJJ6IZuEl19A1Oju4Qf83ExhOetXW2umxDR-fHhtcOVNSK_GmNs Apr 13 15:16:00 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:16:00 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:16:00 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:16:00 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:16:00 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:16:00 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:16:00 user devstack@n-api.service[61873]: X-Project-Id: 738150b0ec0c4ce887397f161c7e8c21 Apr 13 15:16:00 user devstack@n-api.service[61873]: X-Project-Name: tempest-TestMinimumBasicScenario-1239780022 Apr 13 15:16:00 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:16:00 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:16:00 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/738150b0ec0c4ce887397f161c7e8c21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738150b0ec0c4ce887397f161c7e8c21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738150b0ec0c4ce887397f161c7e8c21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:16:00 user devstack@n-api.service[61873]: X-Tenant: tempest-TestMinimumBasicScenario-1239780022 Apr 13 15:16:00 user devstack@n-api.service[61873]: X-Tenant-Id: 738150b0ec0c4ce887397f161c7e8c21 Apr 13 15:16:00 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1239780022 Apr 13 15:16:00 user devstack@n-api.service[61873]: X-User: tempest-TestMinimumBasicScenario-1239780022-project-member Apr 13 15:16:00 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:16:00 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:16:00 user devstack@n-api.service[61873]: X-User-Id: c2322f71af2a478291bfb9d34046394c Apr 13 15:16:00 user devstack@n-api.service[61873]: X-User-Name: tempest-TestMinimumBasicScenario-1239780022-project-member Apr 13 15:16:00 user devstack@n-api.service[61873]: method: > Apr 13 15:16:00 user devstack@n-api.service[61873]: exception: Instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff is not attached to volume f29176ab-5dde-4b23-9e8d-4aee8409dcb0 Apr 13 15:16:00 user devstack@n-api.service[61873]: action_args: {'server_id': '05d57dd8-f51c-4709-a8b9-2f4aeb3039ff', 'id': 'f29176ab-5dde-4b23-9e8d-4aee8409dcb0'} Apr 13 15:16:00 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f29176ab-5dde-4b23-9e8d-4aee8409dcb0. Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff is not attached to volume f29176ab-5dde-4b23-9e8d-4aee8409dcb0 Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff is not attached to volume f29176ab-5dde-4b23-9e8d-4aee8409dcb0 Apr 13 15:16:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:16:00 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-2e919a2b-671e-4ce7-99d9-7696ae5212c2 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Returning 404 to user: Instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff is not attached to volume f29176ab-5dde-4b23-9e8d-4aee8409dcb0 {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:16:00 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-2e919a2b-671e-4ce7-99d9-7696ae5212c2 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/os-volume_attachments/f29176ab-5dde-4b23-9e8d-4aee8409dcb0" status: 404 len: 154 microversion: 2.1 time: 0.106551 Apr 13 15:16:00 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 165/490] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:16:00 2023] DELETE /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/os-volume_attachments/f29176ab-5dde-4b23-9e8d-4aee8409dcb0 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:16:02 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-61057416-7471-4f7b-a635-8e88b7b4b9b1 req-88055f87-2ac8-4c53-9ae4-fb03ae553160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:16:02 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-61057416-7471-4f7b-a635-8e88b7b4b9b1 req-88055f87-2ac8-4c53-9ae4-fb03ae553160 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:02 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-61057416-7471-4f7b-a635-8e88b7b4b9b1 req-88055f87-2ac8-4c53-9ae4-fb03ae553160 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:02 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-61057416-7471-4f7b-a635-8e88b7b4b9b1 req-88055f87-2ac8-4c53-9ae4-fb03ae553160 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:02 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-61057416-7471-4f7b-a635-8e88b7b4b9b1 req-88055f87-2ac8-4c53-9ae4-fb03ae553160 service nova] Creating event network-changed:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:16:02 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-61057416-7471-4f7b-a635-8e88b7b4b9b1 req-88055f87-2ac8-4c53-9ae4-fb03ae553160 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028595 Apr 13 15:16:02 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 165/491] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:16:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:16:02 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-0d76551c-193f-4303-aa16-ea081d2cd823 req-1eadf17a-90f1-425a-93e3-3d761abd93bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc146f3-9150-4920-b468-9aebcbc81162", "tag": "8f16dd83-a089-414b-9525-cc7ef42c7331"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:16:02 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-0d76551c-193f-4303-aa16-ea081d2cd823 req-1eadf17a-90f1-425a-93e3-3d761abd93bc service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:02 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-0d76551c-193f-4303-aa16-ea081d2cd823 req-1eadf17a-90f1-425a-93e3-3d761abd93bc service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:02 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-0d76551c-193f-4303-aa16-ea081d2cd823 req-1eadf17a-90f1-425a-93e3-3d761abd93bc service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:03 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-0d76551c-193f-4303-aa16-ea081d2cd823 req-1eadf17a-90f1-425a-93e3-3d761abd93bc service nova] Creating event network-changed:8f16dd83-a089-414b-9525-cc7ef42c7331 for instance 3dc146f3-9150-4920-b468-9aebcbc81162 on user Apr 13 15:16:03 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-0d76551c-193f-4303-aa16-ea081d2cd823 req-1eadf17a-90f1-425a-93e3-3d761abd93bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040734 Apr 13 15:16:03 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 162/492] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:16:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:16:04 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:16:04 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:16:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:04 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Going to try to terminate instance {{(pid=61873) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:16:04 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" status: 204 len: 0 microversion: 2.1 time: 0.146810 Apr 13 15:16:04 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 166/493] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:16:04 2023] DELETE /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:16:04 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-4a6b1d9a-0eef-4fec-a2aa-8d22d31914cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:16:04 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-4a6b1d9a-0eef-4fec-a2aa-8d22d31914cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:16:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4a6b1d9a-0eef-4fec-a2aa-8d22d31914cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4a6b1d9a-0eef-4fec-a2aa-8d22d31914cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4a6b1d9a-0eef-4fec-a2aa-8d22d31914cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4a6b1d9a-0eef-4fec-a2aa-8d22d31914cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4a6b1d9a-0eef-4fec-a2aa-8d22d31914cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4a6b1d9a-0eef-4fec-a2aa-8d22d31914cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:04 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-4a6b1d9a-0eef-4fec-a2aa-8d22d31914cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:16:04 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-4a6b1d9a-0eef-4fec-a2aa-8d22d31914cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" status: 200 len: 1541 microversion: 2.1 time: 0.183489 Apr 13 15:16:04 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 166/494] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:16:04 2023] GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff => generated 1541 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:16:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-4a086318-0f99-430d-8a7f-38955bfa2403 req-b9957546-9071-4e09-bc7a-c399973c5806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff", "name": "network-vif-unplugged", "status": "completed", "tag": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:16:05 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-4a086318-0f99-430d-8a7f-38955bfa2403 req-b9957546-9071-4e09-bc7a-c399973c5806 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:05 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-4a086318-0f99-430d-8a7f-38955bfa2403 req-b9957546-9071-4e09-bc7a-c399973c5806 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:05 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-4a086318-0f99-430d-8a7f-38955bfa2403 req-b9957546-9071-4e09-bc7a-c399973c5806 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:05 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-4a086318-0f99-430d-8a7f-38955bfa2403 req-b9957546-9071-4e09-bc7a-c399973c5806 service nova] Creating event network-vif-unplugged:f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff on user Apr 13 15:16:05 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-4a086318-0f99-430d-8a7f-38955bfa2403 req-b9957546-9071-4e09-bc7a-c399973c5806 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043717 Apr 13 15:16:05 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 163/495] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:16:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:16:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-5aa99d4c-51b0-415f-81bd-92c06e995f11 req-411b601a-714d-481b-b5f5-f8348256fc71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "name": "network-vif-plugged", "status": "completed", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:16:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5aa99d4c-51b0-415f-81bd-92c06e995f11 req-411b601a-714d-481b-b5f5-f8348256fc71 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5aa99d4c-51b0-415f-81bd-92c06e995f11 req-411b601a-714d-481b-b5f5-f8348256fc71 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5aa99d4c-51b0-415f-81bd-92c06e995f11 req-411b601a-714d-481b-b5f5-f8348256fc71 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:05 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-5aa99d4c-51b0-415f-81bd-92c06e995f11 req-411b601a-714d-481b-b5f5-f8348256fc71 service nova] Creating event network-vif-plugged:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:16:05 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-5aa99d4c-51b0-415f-81bd-92c06e995f11 req-411b601a-714d-481b-b5f5-f8348256fc71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030364 Apr 13 15:16:05 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 167/496] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:16:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:16:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-6ceecd32-7548-497f-9082-4a38256e74ff req-51da1e8b-e1fd-4585-a52f-055fbea49755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc146f3-9150-4920-b468-9aebcbc81162", "name": "network-vif-plugged", "status": "completed", "tag": "8f16dd83-a089-414b-9525-cc7ef42c7331"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:16:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-6ceecd32-7548-497f-9082-4a38256e74ff req-51da1e8b-e1fd-4585-a52f-055fbea49755 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-6ceecd32-7548-497f-9082-4a38256e74ff req-51da1e8b-e1fd-4585-a52f-055fbea49755 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-6ceecd32-7548-497f-9082-4a38256e74ff req-51da1e8b-e1fd-4585-a52f-055fbea49755 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:06 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-6ceecd32-7548-497f-9082-4a38256e74ff req-51da1e8b-e1fd-4585-a52f-055fbea49755 service nova] Creating event network-vif-plugged:8f16dd83-a089-414b-9525-cc7ef42c7331 for instance 3dc146f3-9150-4920-b468-9aebcbc81162 on user Apr 13 15:16:06 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-6ceecd32-7548-497f-9082-4a38256e74ff req-51da1e8b-e1fd-4585-a52f-055fbea49755 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048456 Apr 13 15:16:06 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 167/497] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:16:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:16:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-604430842", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "networks": [{"uuid": "928c080b-0ead-4f65-85b3-2c98a7549dbb"}]}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:16:06 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] validate_networks() for [('928c080b-0ead-4f65-85b3-2c98a7549dbb', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:16:07 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-cec96aab-981d-4486-88df-76f08f5744ca req-95cdc3aa-437b-4d0d-ae02-35bf0f20cc9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff", "name": "network-vif-plugged", "status": "completed", "tag": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3"}, {"server_uuid": "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff", "name": "network-vif-deleted", "tag": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:16:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-cec96aab-981d-4486-88df-76f08f5744ca req-95cdc3aa-437b-4d0d-ae02-35bf0f20cc9c service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-cec96aab-981d-4486-88df-76f08f5744ca req-95cdc3aa-437b-4d0d-ae02-35bf0f20cc9c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-cec96aab-981d-4486-88df-76f08f5744ca req-95cdc3aa-437b-4d0d-ae02-35bf0f20cc9c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:07 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-cec96aab-981d-4486-88df-76f08f5744ca req-95cdc3aa-437b-4d0d-ae02-35bf0f20cc9c service nova] Creating event network-vif-plugged:f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff on user Apr 13 15:16:07 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-cec96aab-981d-4486-88df-76f08f5744ca req-95cdc3aa-437b-4d0d-ae02-35bf0f20cc9c service nova] Creating event network-vif-deleted:f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff on user Apr 13 15:16:07 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-cec96aab-981d-4486-88df-76f08f5744ca req-95cdc3aa-437b-4d0d-ae02-35bf0f20cc9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034666 Apr 13 15:16:07 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 168/498] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:16:07 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:16:07 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:16:07 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:16:07 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:16:07 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:16:07 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:16:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:07 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Getting quotas for project 240b28f42732478ba732994b2c9e3fbe. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:16:07 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Getting quotas for user 75bf6e19993f4c2e90fd52c4d6212622 and project 240b28f42732478ba732994b2c9e3fbe. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:16:07 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:16:07 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:16:07 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.794307 Apr 13 15:16:07 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 164/499] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 15:16:06 2023] POST /compute/v2.1/servers => generated 378 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 15:16:07 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-b21e6e78-29b0-44aa-adc4-cf577ded77ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:16:07 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-b21e6e78-29b0-44aa-adc4-cf577ded77ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:16:07 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-b21e6e78-29b0-44aa-adc4-cf577ded77ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:16:07 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-b21e6e78-29b0-44aa-adc4-cf577ded77ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:16:07 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-b21e6e78-29b0-44aa-adc4-cf577ded77ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:16:07 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-b21e6e78-29b0-44aa-adc4-cf577ded77ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/149f8be9-79d3-4922-b3cc-c164b8b81534" status: 200 len: 1394 microversion: 2.87 time: 0.069930 Apr 13 15:16:07 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 168/500] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:16:07 2023] GET /compute/v2.1/servers/149f8be9-79d3-4922-b3cc-c164b8b81534 => generated 1394 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:16:07 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-c4e6b7f7-b832-42a6-9d32-9e64f98074f5 req-8ca12565-4840-472f-9899-4bef9797b8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "name": "network-vif-plugged", "status": "completed", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:16:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c4e6b7f7-b832-42a6-9d32-9e64f98074f5 req-8ca12565-4840-472f-9899-4bef9797b8f8 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c4e6b7f7-b832-42a6-9d32-9e64f98074f5 req-8ca12565-4840-472f-9899-4bef9797b8f8 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c4e6b7f7-b832-42a6-9d32-9e64f98074f5 req-8ca12565-4840-472f-9899-4bef9797b8f8 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:07 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-c4e6b7f7-b832-42a6-9d32-9e64f98074f5 req-8ca12565-4840-472f-9899-4bef9797b8f8 service nova] Creating event network-vif-plugged:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:16:07 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-c4e6b7f7-b832-42a6-9d32-9e64f98074f5 req-8ca12565-4840-472f-9899-4bef9797b8f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039315 Apr 13 15:16:07 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 169/501] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:16:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:16:08 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-a5f1f8d5-e81d-43ea-bee6-f9cedf922937 req-a8e37dbd-2ea1-4319-8dde-13def9329e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc146f3-9150-4920-b468-9aebcbc81162", "name": "network-vif-plugged", "status": "completed", "tag": "8f16dd83-a089-414b-9525-cc7ef42c7331"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:16:08 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=4 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:16:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a5f1f8d5-e81d-43ea-bee6-f9cedf922937 req-a8e37dbd-2ea1-4319-8dde-13def9329e52 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a5f1f8d5-e81d-43ea-bee6-f9cedf922937 req-a8e37dbd-2ea1-4319-8dde-13def9329e52 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a5f1f8d5-e81d-43ea-bee6-f9cedf922937 req-a8e37dbd-2ea1-4319-8dde-13def9329e52 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:08 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-a5f1f8d5-e81d-43ea-bee6-f9cedf922937 req-a8e37dbd-2ea1-4319-8dde-13def9329e52 service nova] Creating event network-vif-plugged:8f16dd83-a089-414b-9525-cc7ef42c7331 for instance 3dc146f3-9150-4920-b468-9aebcbc81162 on user Apr 13 15:16:08 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-a5f1f8d5-e81d-43ea-bee6-f9cedf922937 req-a8e37dbd-2ea1-4319-8dde-13def9329e52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036520 Apr 13 15:16:08 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 165/502] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:16:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:16:10 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-35be5dbb-6bd8-4d34-b472-1ac16e111eb5 req-5fbe8e03-fbeb-4231-81ed-b1bb446151d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149f8be9-79d3-4922-b3cc-c164b8b81534", "tag": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:16:10 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:16:10 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:16:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-35be5dbb-6bd8-4d34-b472-1ac16e111eb5 req-5fbe8e03-fbeb-4231-81ed-b1bb446151d3 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-35be5dbb-6bd8-4d34-b472-1ac16e111eb5 req-5fbe8e03-fbeb-4231-81ed-b1bb446151d3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-35be5dbb-6bd8-4d34-b472-1ac16e111eb5 req-5fbe8e03-fbeb-4231-81ed-b1bb446151d3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:10 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-35be5dbb-6bd8-4d34-b472-1ac16e111eb5 req-5fbe8e03-fbeb-4231-81ed-b1bb446151d3 service nova] Creating event network-changed:67be9d84-c425-4bd9-8b9e-6ea31add6ccf for instance 149f8be9-79d3-4922-b3cc-c164b8b81534 on user Apr 13 15:16:10 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-35be5dbb-6bd8-4d34-b472-1ac16e111eb5 req-5fbe8e03-fbeb-4231-81ed-b1bb446151d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051943 Apr 13 15:16:10 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 169/503] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:16:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:16:12 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-f4ef729f-e3ee-4079-a883-1100dc8d6b0f req-440fa917-7475-4f6e-8580-d11cdf2449d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149f8be9-79d3-4922-b3cc-c164b8b81534", "name": "network-vif-plugged", "status": "completed", "tag": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:16:12 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:16:12 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=10 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:16:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-f4ef729f-e3ee-4079-a883-1100dc8d6b0f req-440fa917-7475-4f6e-8580-d11cdf2449d1 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-f4ef729f-e3ee-4079-a883-1100dc8d6b0f req-440fa917-7475-4f6e-8580-d11cdf2449d1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-f4ef729f-e3ee-4079-a883-1100dc8d6b0f req-440fa917-7475-4f6e-8580-d11cdf2449d1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:12 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-f4ef729f-e3ee-4079-a883-1100dc8d6b0f req-440fa917-7475-4f6e-8580-d11cdf2449d1 service nova] Creating event network-vif-plugged:67be9d84-c425-4bd9-8b9e-6ea31add6ccf for instance 149f8be9-79d3-4922-b3cc-c164b8b81534 on user Apr 13 15:16:12 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-f4ef729f-e3ee-4079-a883-1100dc8d6b0f req-440fa917-7475-4f6e-8580-d11cdf2449d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046806 Apr 13 15:16:12 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 170/504] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:16:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:16:13 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-0219edc3-c256-4195-9c2e-e914f2ad6a1f tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:16:13 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-0219edc3-c256-4195-9c2e-e914f2ad6a1f tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:16:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0219edc3-c256-4195-9c2e-e914f2ad6a1f tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0219edc3-c256-4195-9c2e-e914f2ad6a1f tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0219edc3-c256-4195-9c2e-e914f2ad6a1f tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0219edc3-c256-4195-9c2e-e914f2ad6a1f tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0219edc3-c256-4195-9c2e-e914f2ad6a1f tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0219edc3-c256-4195-9c2e-e914f2ad6a1f tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:13 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-0219edc3-c256-4195-9c2e-e914f2ad6a1f tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] HTTP exception thrown: Instance 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae could not be found. Apr 13 15:16:13 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-0219edc3-c256-4195-9c2e-e914f2ad6a1f tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Request method failure captured: Apr 13 15:16:13 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae HTTP/1.1 Apr 13 15:16:13 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:16:13 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:16:13 user devstack@n-api.service[61871]: Connection: close Apr 13 15:16:13 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:16:13 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:16:13 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:16:13 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:16:13 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:16:13 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBt3vzdMP0YUp3fFnaU-54u96GQd1lcaZV59AxgHhylSZKTOiFPRA7dgu2A7HFuRKQHGbf3gt30Z1p9DMQ9aBxUY6YGBleKDSdmt9y0rkQdnEDmaa0jhLRDXH1L7mEJ7w2DnY-sb3RYHWd7ait-B2RKGcq6btONfKQyAn6GTLeU646c Apr 13 15:16:13 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:16:13 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:16:13 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:16:13 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:16:13 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:16:13 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:16:13 user devstack@n-api.service[61871]: X-Project-Id: 2c0cae04ab4b4157a7ef786d165789a6 Apr 13 15:16:13 user devstack@n-api.service[61871]: X-Project-Name: tempest-VolumesActionsTest-119634704 Apr 13 15:16:13 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:16:13 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:16:13 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c0cae04ab4b4157a7ef786d165789a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c0cae04ab4b4157a7ef786d165789a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c0cae04ab4b4157a7ef786d165789a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:16:13 user devstack@n-api.service[61871]: X-Tenant: tempest-VolumesActionsTest-119634704 Apr 13 15:16:13 user devstack@n-api.service[61871]: X-Tenant-Id: 2c0cae04ab4b4157a7ef786d165789a6 Apr 13 15:16:13 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-VolumesActionsTest-119634704 Apr 13 15:16:13 user devstack@n-api.service[61871]: X-User: tempest-VolumesActionsTest-119634704-project-member Apr 13 15:16:13 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:16:13 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:16:13 user devstack@n-api.service[61871]: X-User-Id: 3bdc942f33ca46c08bb143ed2efeb458 Apr 13 15:16:13 user devstack@n-api.service[61871]: X-User-Name: tempest-VolumesActionsTest-119634704-project-member Apr 13 15:16:13 user devstack@n-api.service[61871]: method: > Apr 13 15:16:13 user devstack@n-api.service[61871]: exception: Instance 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae could not be found. Apr 13 15:16:13 user devstack@n-api.service[61871]: action_args: {'id': '9bad86ad-6d5b-45f1-bcd8-4dea5be345ae'} Apr 13 15:16:13 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae could not be found. Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae could not be found. Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae could not be found. Apr 13 15:16:13 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:16:13 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-0219edc3-c256-4195-9c2e-e914f2ad6a1f tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Returning 404 to user: Instance 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:16:13 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-0219edc3-c256-4195-9c2e-e914f2ad6a1f tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" status: 404 len: 111 microversion: 2.1 time: 0.158128 Apr 13 15:16:13 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 166/505] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:16:13 2023] GET /compute/v2.1/servers/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:16:14 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-e90034d5-8020-4c8d-9bef-cd0a4ffc0fad req-179acdb7-05cb-41a0-b2ee-eb98a873f84e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149f8be9-79d3-4922-b3cc-c164b8b81534", "name": "network-vif-plugged", "status": "completed", "tag": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:16:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-e90034d5-8020-4c8d-9bef-cd0a4ffc0fad req-179acdb7-05cb-41a0-b2ee-eb98a873f84e service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-e90034d5-8020-4c8d-9bef-cd0a4ffc0fad req-179acdb7-05cb-41a0-b2ee-eb98a873f84e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-e90034d5-8020-4c8d-9bef-cd0a4ffc0fad req-179acdb7-05cb-41a0-b2ee-eb98a873f84e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:14 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-e90034d5-8020-4c8d-9bef-cd0a4ffc0fad req-179acdb7-05cb-41a0-b2ee-eb98a873f84e service nova] Creating event network-vif-plugged:67be9d84-c425-4bd9-8b9e-6ea31add6ccf for instance 149f8be9-79d3-4922-b3cc-c164b8b81534 on user Apr 13 15:16:14 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-e90034d5-8020-4c8d-9bef-cd0a4ffc0fad req-179acdb7-05cb-41a0-b2ee-eb98a873f84e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036562 Apr 13 15:16:14 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 170/506] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:16:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:16:26 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:16:26 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:16:26 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-e7896061-82c5-425c-abd1-249b839362c4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:16:26 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-e7896061-82c5-425c-abd1-249b839362c4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:16:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e7896061-82c5-425c-abd1-249b839362c4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e7896061-82c5-425c-abd1-249b839362c4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e7896061-82c5-425c-abd1-249b839362c4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e7896061-82c5-425c-abd1-249b839362c4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e7896061-82c5-425c-abd1-249b839362c4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e7896061-82c5-425c-abd1-249b839362c4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:26 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-e7896061-82c5-425c-abd1-249b839362c4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:16:26 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-e7896061-82c5-425c-abd1-249b839362c4 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1722 microversion: 2.1 time: 0.267890 Apr 13 15:16:26 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 171/507] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:16:26 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:16:36 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:16:36 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=12 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:16:36 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:16:36 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=16 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:16:36 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:16:36 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:36 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:36 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:36 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Going to try to start instance {{(pid=61871) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 13 15:16:36 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3/action" status: 202 len: 0 microversion: 2.1 time: 0.103958 Apr 13 15:16:36 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 167/508] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:16:36 2023] POST /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:16:36 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=10 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:16:36 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=3 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:16:36 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=15 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:16:36 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d414dce4-714a-46d7-bc96-fd4cf69376cd tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:16:36 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-d414dce4-714a-46d7-bc96-fd4cf69376cd tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:16:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d414dce4-714a-46d7-bc96-fd4cf69376cd tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d414dce4-714a-46d7-bc96-fd4cf69376cd tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d414dce4-714a-46d7-bc96-fd4cf69376cd tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d414dce4-714a-46d7-bc96-fd4cf69376cd tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d414dce4-714a-46d7-bc96-fd4cf69376cd tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d414dce4-714a-46d7-bc96-fd4cf69376cd tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:36 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-d414dce4-714a-46d7-bc96-fd4cf69376cd tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1a698b103a47c0b2864eef54be648b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceba33821a9b4f7aa81c2857c11261f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:16:36 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-d414dce4-714a-46d7-bc96-fd4cf69376cd tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3" status: 200 len: 1696 microversion: 2.1 time: 0.196868 Apr 13 15:16:36 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 171/509] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:16:36 2023] GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3 => generated 1696 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:16:42 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-7b9f0494-8916-4d11-8c39-adf6d14cb341 req-ec086125-4f9b-45c7-afaf-0ebbda227196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa74d14-db6f-41f5-b8af-32da312209d3", "name": "network-vif-plugged", "status": "completed", "tag": "84611f06-d6ca-49e1-afe7-7723921e62dc"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:16:42 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:16:42 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:16:42 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-7b9f0494-8916-4d11-8c39-adf6d14cb341 req-ec086125-4f9b-45c7-afaf-0ebbda227196 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:42 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-7b9f0494-8916-4d11-8c39-adf6d14cb341 req-ec086125-4f9b-45c7-afaf-0ebbda227196 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:42 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-7b9f0494-8916-4d11-8c39-adf6d14cb341 req-ec086125-4f9b-45c7-afaf-0ebbda227196 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:42 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-7b9f0494-8916-4d11-8c39-adf6d14cb341 req-ec086125-4f9b-45c7-afaf-0ebbda227196 service nova] Creating event network-vif-plugged:84611f06-d6ca-49e1-afe7-7723921e62dc for instance 1aa74d14-db6f-41f5-b8af-32da312209d3 on user Apr 13 15:16:42 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-7b9f0494-8916-4d11-8c39-adf6d14cb341 req-ec086125-4f9b-45c7-afaf-0ebbda227196 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048744 Apr 13 15:16:42 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 172/510] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:16:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:16:44 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-763b6e50-116c-4440-b776-f80b72b6f865 req-3bebddbd-78fd-415b-a6b7-6fd4107c5620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa74d14-db6f-41f5-b8af-32da312209d3", "name": "network-vif-plugged", "status": "completed", "tag": "84611f06-d6ca-49e1-afe7-7723921e62dc"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:16:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-763b6e50-116c-4440-b776-f80b72b6f865 req-3bebddbd-78fd-415b-a6b7-6fd4107c5620 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-763b6e50-116c-4440-b776-f80b72b6f865 req-3bebddbd-78fd-415b-a6b7-6fd4107c5620 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-763b6e50-116c-4440-b776-f80b72b6f865 req-3bebddbd-78fd-415b-a6b7-6fd4107c5620 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:45 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-763b6e50-116c-4440-b776-f80b72b6f865 req-3bebddbd-78fd-415b-a6b7-6fd4107c5620 service nova] Creating event network-vif-plugged:84611f06-d6ca-49e1-afe7-7723921e62dc for instance 1aa74d14-db6f-41f5-b8af-32da312209d3 on user Apr 13 15:16:45 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-763b6e50-116c-4440-b776-f80b72b6f865 req-3bebddbd-78fd-415b-a6b7-6fd4107c5620 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045570 Apr 13 15:16:45 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 168/511] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:16:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:16:49 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-9dc57608-0c01-428f-81d1-a779b57b7a37 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:16:49 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-9dc57608-0c01-428f-81d1-a779b57b7a37 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:16:49 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:16:49 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:16:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dc57608-0c01-428f-81d1-a779b57b7a37 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dc57608-0c01-428f-81d1-a779b57b7a37 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dc57608-0c01-428f-81d1-a779b57b7a37 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dc57608-0c01-428f-81d1-a779b57b7a37 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dc57608-0c01-428f-81d1-a779b57b7a37 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dc57608-0c01-428f-81d1-a779b57b7a37 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:49 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-9dc57608-0c01-428f-81d1-a779b57b7a37 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:16:49 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-9dc57608-0c01-428f-81d1-a779b57b7a37 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e" status: 200 len: 1553 microversion: 2.1 time: 0.233028 Apr 13 15:16:49 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 172/512] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:16:49 2023] GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:16:49 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c0760aa2-98ba-4512-9771-b3a3b68c1801 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:16:49 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-c0760aa2-98ba-4512-9771-b3a3b68c1801 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:16:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c0760aa2-98ba-4512-9771-b3a3b68c1801 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c0760aa2-98ba-4512-9771-b3a3b68c1801 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c0760aa2-98ba-4512-9771-b3a3b68c1801 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c0760aa2-98ba-4512-9771-b3a3b68c1801 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c0760aa2-98ba-4512-9771-b3a3b68c1801 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c0760aa2-98ba-4512-9771-b3a3b68c1801 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:49 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-c0760aa2-98ba-4512-9771-b3a3b68c1801 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedd34ccc15c47f9a4fc96b080730acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3ba2d132c445039d0ae30ffd2bc64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:16:49 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-c0760aa2-98ba-4512-9771-b3a3b68c1801 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162" status: 200 len: 1545 microversion: 2.1 time: 0.191891 Apr 13 15:16:49 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 173/513] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:16:49 2023] GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162 => generated 1545 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:16:54 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-4813d62b-36ef-4503-b147-07e25be870a5 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:16:54 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-4813d62b-36ef-4503-b147-07e25be870a5 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:16:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4813d62b-36ef-4503-b147-07e25be870a5 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4813d62b-36ef-4503-b147-07e25be870a5 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4813d62b-36ef-4503-b147-07e25be870a5 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4813d62b-36ef-4503-b147-07e25be870a5 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4813d62b-36ef-4503-b147-07e25be870a5 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4813d62b-36ef-4503-b147-07e25be870a5 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:54 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-4813d62b-36ef-4503-b147-07e25be870a5 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] HTTP exception thrown: Instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff could not be found. Apr 13 15:16:54 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-4813d62b-36ef-4503-b147-07e25be870a5 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Request method failure captured: Apr 13 15:16:54 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff HTTP/1.1 Apr 13 15:16:54 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:16:54 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:16:54 user devstack@n-api.service[61871]: Connection: close Apr 13 15:16:54 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:16:54 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:16:54 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:16:54 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:16:54 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:16:54 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBt_gL21F_HIzMNmMeHvCDxve6FeNon6Vk99gIHKSfsweejUx9M3I34NpTA5cEP08XCf4a9uHtu9GTiU0WZa1B6p4O_X0BvfGoqlTBj9g-4Mh1KzprzD4zd4ps5-GJJ6IZuEl19A1Oju4Qf83ExhOetXW2umxDR-fHhtcOVNSK_GmNs Apr 13 15:16:54 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:16:54 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:16:54 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:16:54 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:16:54 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:16:54 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:16:54 user devstack@n-api.service[61871]: X-Project-Id: 738150b0ec0c4ce887397f161c7e8c21 Apr 13 15:16:54 user devstack@n-api.service[61871]: X-Project-Name: tempest-TestMinimumBasicScenario-1239780022 Apr 13 15:16:54 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:16:54 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:16:54 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/738150b0ec0c4ce887397f161c7e8c21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738150b0ec0c4ce887397f161c7e8c21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738150b0ec0c4ce887397f161c7e8c21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:16:54 user devstack@n-api.service[61871]: X-Tenant: tempest-TestMinimumBasicScenario-1239780022 Apr 13 15:16:54 user devstack@n-api.service[61871]: X-Tenant-Id: 738150b0ec0c4ce887397f161c7e8c21 Apr 13 15:16:54 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1239780022 Apr 13 15:16:54 user devstack@n-api.service[61871]: X-User: tempest-TestMinimumBasicScenario-1239780022-project-member Apr 13 15:16:54 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:16:54 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:16:54 user devstack@n-api.service[61871]: X-User-Id: c2322f71af2a478291bfb9d34046394c Apr 13 15:16:54 user devstack@n-api.service[61871]: X-User-Name: tempest-TestMinimumBasicScenario-1239780022-project-member Apr 13 15:16:54 user devstack@n-api.service[61871]: method: > Apr 13 15:16:54 user devstack@n-api.service[61871]: exception: Instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff could not be found. Apr 13 15:16:54 user devstack@n-api.service[61871]: action_args: {'id': '05d57dd8-f51c-4709-a8b9-2f4aeb3039ff'} Apr 13 15:16:54 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff could not be found. Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff could not be found. Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:16:54 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:16:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:16:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:16:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:16:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff could not be found. Apr 13 15:16:55 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:16:55 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-4813d62b-36ef-4503-b147-07e25be870a5 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Returning 404 to user: Instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:16:55 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-4813d62b-36ef-4503-b147-07e25be870a5 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" status: 404 len: 111 microversion: 2.1 time: 0.040473 Apr 13 15:16:55 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 169/514] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:16:54 2023] GET /compute/v2.1/servers/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:16:55 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-da766006-bbfe-452d-aa69-417dd4ac82ce tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '.version_select at 0x7f3a8fab9ab0>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:16:55 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-da766006-bbfe-452d-aa69-417dd4ac82ce tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1980539872" status: 202 len: 0 microversion: 2.1 time: 0.035015 Apr 13 15:16:55 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 173/515] 10.0.0.210 () {62 vars in 1349 bytes} [Thu Apr 13 15:16:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1980539872 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:16:57 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-835cb5e1-c019-4836-b3cd-a6522d4de566 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Action: 'create', calling method: .version_select at 0x7f3a8b934ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1152073766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDICxl86jLmymXogxNUJnQZrjPr/+8MrnAGTcu90n9UjsNhs+u6Mh3/NJl7vyFtf7K8I7ur6kH+VunKTEjTglWZT45qzOhWEU+r6IQk98Mkud+AgqZr5Ga1+FcK2IHkJEA=="}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:16:57 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-835cb5e1-c019-4836-b3cd-a6522d4de566 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Getting quotas for project 738150b0ec0c4ce887397f161c7e8c21. Resources: {'key_pairs'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:16:57 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-835cb5e1-c019-4836-b3cd-a6522d4de566 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Getting quotas for user c2322f71af2a478291bfb9d34046394c and project 738150b0ec0c4ce887397f161c7e8c21. Resources: {'key_pairs'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:16:57 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-835cb5e1-c019-4836-b3cd-a6522d4de566 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049677 Apr 13 15:16:57 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 174/516] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 15:16:57 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:16:57 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-2b35c09e-9309-4c99-819e-fd6c651f0058 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:16:57 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-2b35c09e-9309-4c99-819e-fd6c651f0058 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:16:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2b35c09e-9309-4c99-819e-fd6c651f0058 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2b35c09e-9309-4c99-819e-fd6c651f0058 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2b35c09e-9309-4c99-819e-fd6c651f0058 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2b35c09e-9309-4c99-819e-fd6c651f0058 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2b35c09e-9309-4c99-819e-fd6c651f0058 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2b35c09e-9309-4c99-819e-fd6c651f0058 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:57 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-460869719", "imageRef": "a611381e-716d-4625-bba9-2ca0eb316ad3", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1152073766", "networks": [{"uuid": "31820944-67f5-43ce-b68d-522060649204"}]}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:16:57 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-2b35c09e-9309-4c99-819e-fd6c651f0058 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:16:57 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-2b35c09e-9309-4c99-819e-fd6c651f0058 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:16:57 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-2b35c09e-9309-4c99-819e-fd6c651f0058 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:16:57 user devstack@n-api.service[61872]: DEBUG nova.network.neutron [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] validate_networks() for [('31820944-67f5-43ce-b68d-522060649204', None, None, None, None, None)] {{(pid=61872) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:16:57 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-2b35c09e-9309-4c99-819e-fd6c651f0058 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/149f8be9-79d3-4922-b3cc-c164b8b81534" status: 200 len: 1690 microversion: 2.87 time: 0.221817 Apr 13 15:16:57 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 170/517] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:16:57 2023] GET /compute/v2.1/servers/149f8be9-79d3-4922-b3cc-c164b8b81534 => generated 1690 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:16:58 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Flavor limits 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:16:58 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Image limits 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:16:58 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Flavor pref 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:16:58 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Image pref 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:16:58 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:16:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:16:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:16:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:16:58 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Getting quotas for project 738150b0ec0c4ce887397f161c7e8c21. Resources: {'cores', 'instances', 'ram'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:16:58 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Getting quotas for user c2322f71af2a478291bfb9d34046394c and project 738150b0ec0c4ce887397f161c7e8c21. Resources: {'cores', 'instances', 'ram'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:16:58 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Going to run 1 instances... {{(pid=61872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:16:58 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a611381e-716d-4625-bba9-2ca0eb316ad3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:16:58 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.556451 Apr 13 15:16:58 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 174/518] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:16:57 2023] POST /compute/v2.1/servers => generated 378 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:16:58 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-25c04667-e031-4358-a7bf-aa7dae3d6c72 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:16:58 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-25c04667-e031-4358-a7bf-aa7dae3d6c72 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:16:58 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-25c04667-e031-4358-a7bf-aa7dae3d6c72 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:16:58 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-25c04667-e031-4358-a7bf-aa7dae3d6c72 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" status: 200 len: 1252 microversion: 2.1 time: 0.080684 Apr 13 15:16:58 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 175/519] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:16:58 2023] GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe => generated 1252 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:17:01 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-a6c90515-488d-44e0-9178-c067086f84f7 req-8ffbf908-619a-460e-acd9-9dd5e5daca51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe", "tag": "df99421e-bdc6-4fe5-9865-823bcb128ccc"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:17:01 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a6c90515-488d-44e0-9178-c067086f84f7 req-8ffbf908-619a-460e-acd9-9dd5e5daca51 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:01 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a6c90515-488d-44e0-9178-c067086f84f7 req-8ffbf908-619a-460e-acd9-9dd5e5daca51 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:01 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a6c90515-488d-44e0-9178-c067086f84f7 req-8ffbf908-619a-460e-acd9-9dd5e5daca51 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:01 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-a6c90515-488d-44e0-9178-c067086f84f7 req-8ffbf908-619a-460e-acd9-9dd5e5daca51 service nova] Creating event network-changed:df99421e-bdc6-4fe5-9865-823bcb128ccc for instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe on user Apr 13 15:17:01 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-a6c90515-488d-44e0-9178-c067086f84f7 req-8ffbf908-619a-460e-acd9-9dd5e5daca51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027874 Apr 13 15:17:01 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 171/520] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:17:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:17:03 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-0004fcd8-364b-4a33-a7f3-52b66138da8e req-d75d8e02-448d-44e8-860f-8b201ddee208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe", "name": "network-vif-plugged", "status": "completed", "tag": "df99421e-bdc6-4fe5-9865-823bcb128ccc"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:17:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-0004fcd8-364b-4a33-a7f3-52b66138da8e req-d75d8e02-448d-44e8-860f-8b201ddee208 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-0004fcd8-364b-4a33-a7f3-52b66138da8e req-d75d8e02-448d-44e8-860f-8b201ddee208 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-0004fcd8-364b-4a33-a7f3-52b66138da8e req-d75d8e02-448d-44e8-860f-8b201ddee208 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:03 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-0004fcd8-364b-4a33-a7f3-52b66138da8e req-d75d8e02-448d-44e8-860f-8b201ddee208 service nova] Creating event network-vif-plugged:df99421e-bdc6-4fe5-9865-823bcb128ccc for instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe on user Apr 13 15:17:03 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-0004fcd8-364b-4a33-a7f3-52b66138da8e req-d75d8e02-448d-44e8-860f-8b201ddee208 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035649 Apr 13 15:17:03 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 175/521] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:17:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:17:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-cc1ca94a-c2fe-4475-a773-c6080b6d0150 req-ae3c8475-25fc-4f13-8416-bd01aa924d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe", "name": "network-vif-plugged", "status": "completed", "tag": "df99421e-bdc6-4fe5-9865-823bcb128ccc"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:17:05 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=8 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:17:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-cc1ca94a-c2fe-4475-a773-c6080b6d0150 req-ae3c8475-25fc-4f13-8416-bd01aa924d0b service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-cc1ca94a-c2fe-4475-a773-c6080b6d0150 req-ae3c8475-25fc-4f13-8416-bd01aa924d0b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-cc1ca94a-c2fe-4475-a773-c6080b6d0150 req-ae3c8475-25fc-4f13-8416-bd01aa924d0b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:05 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-cc1ca94a-c2fe-4475-a773-c6080b6d0150 req-ae3c8475-25fc-4f13-8416-bd01aa924d0b service nova] Creating event network-vif-plugged:df99421e-bdc6-4fe5-9865-823bcb128ccc for instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe on user Apr 13 15:17:05 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-cc1ca94a-c2fe-4475-a773-c6080b6d0150 req-ae3c8475-25fc-4f13-8416-bd01aa924d0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039766 Apr 13 15:17:05 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 176/522] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:17:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:17:26 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=12 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:17:26 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:17:26 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d876910f-70f7-4e27-aa5d-5910156781d0 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:17:26 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-d876910f-70f7-4e27-aa5d-5910156781d0 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:17:26 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:17:26 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:17:26 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:17:26 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=10 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:17:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d876910f-70f7-4e27-aa5d-5910156781d0 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d876910f-70f7-4e27-aa5d-5910156781d0 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d876910f-70f7-4e27-aa5d-5910156781d0 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d876910f-70f7-4e27-aa5d-5910156781d0 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d876910f-70f7-4e27-aa5d-5910156781d0 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d876910f-70f7-4e27-aa5d-5910156781d0 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:26 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-157a34a9-c3da-4893-b19b-9289bd89f38b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:17:26 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-157a34a9-c3da-4893-b19b-9289bd89f38b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:17:26 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-157a34a9-c3da-4893-b19b-9289bd89f38b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:26 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-157a34a9-c3da-4893-b19b-9289bd89f38b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:26 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-157a34a9-c3da-4893-b19b-9289bd89f38b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:26 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-157a34a9-c3da-4893-b19b-9289bd89f38b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:26 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-157a34a9-c3da-4893-b19b-9289bd89f38b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:26 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-157a34a9-c3da-4893-b19b-9289bd89f38b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:26 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-d876910f-70f7-4e27-aa5d-5910156781d0 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1a698b103a47c0b2864eef54be648b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceba33821a9b4f7aa81c2857c11261f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:17:26 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-d876910f-70f7-4e27-aa5d-5910156781d0 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3" status: 200 len: 1700 microversion: 2.1 time: 0.273622 Apr 13 15:17:26 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 176/523] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:17:26 2023] GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3 => generated 1700 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:17:26 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-157a34a9-c3da-4893-b19b-9289bd89f38b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:17:26 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-157a34a9-c3da-4893-b19b-9289bd89f38b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1722 microversion: 2.1 time: 0.523783 Apr 13 15:17:26 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 172/524] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:17:26 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1722 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:17:27 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-2d5112ce-2cc8-4359-a2ce-c3eff256949c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:17:27 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-2d5112ce-2cc8-4359-a2ce-c3eff256949c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:17:27 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:17:27 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:17:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2d5112ce-2cc8-4359-a2ce-c3eff256949c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2d5112ce-2cc8-4359-a2ce-c3eff256949c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2d5112ce-2cc8-4359-a2ce-c3eff256949c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2d5112ce-2cc8-4359-a2ce-c3eff256949c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2d5112ce-2cc8-4359-a2ce-c3eff256949c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2d5112ce-2cc8-4359-a2ce-c3eff256949c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:27 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-2d5112ce-2cc8-4359-a2ce-c3eff256949c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:17:27 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-2d5112ce-2cc8-4359-a2ce-c3eff256949c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1722 microversion: 2.1 time: 0.217348 Apr 13 15:17:27 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 177/525] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:17:27 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:17:48 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-55f7b700-bd23-4f96-be18-1db812f38559 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:17:48 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-55f7b700-bd23-4f96-be18-1db812f38559 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:17:48 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:17:48 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:17:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-55f7b700-bd23-4f96-be18-1db812f38559 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-55f7b700-bd23-4f96-be18-1db812f38559 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-55f7b700-bd23-4f96-be18-1db812f38559 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-55f7b700-bd23-4f96-be18-1db812f38559 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-55f7b700-bd23-4f96-be18-1db812f38559 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-55f7b700-bd23-4f96-be18-1db812f38559 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:48 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-55f7b700-bd23-4f96-be18-1db812f38559 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:17:48 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-55f7b700-bd23-4f96-be18-1db812f38559 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" status: 200 len: 1535 microversion: 2.1 time: 0.151055 Apr 13 15:17:48 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 177/526] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:17:48 2023] GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe => generated 1535 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:17:49 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-aa4de0bd-b4cb-4758-b981-5f9abaae264d tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:17:49 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-aa4de0bd-b4cb-4758-b981-5f9abaae264d tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:17:49 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:17:49 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:17:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-aa4de0bd-b4cb-4758-b981-5f9abaae264d tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-aa4de0bd-b4cb-4758-b981-5f9abaae264d tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-aa4de0bd-b4cb-4758-b981-5f9abaae264d tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-aa4de0bd-b4cb-4758-b981-5f9abaae264d tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-aa4de0bd-b4cb-4758-b981-5f9abaae264d tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-aa4de0bd-b4cb-4758-b981-5f9abaae264d tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:49 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-aa4de0bd-b4cb-4758-b981-5f9abaae264d tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.091486 Apr 13 15:17:49 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 173/527] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 15:17:49 2023] GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e/os-interface => generated 283 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:17:49 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-9a3c459f-fcbf-4292-ac47-de324b4cfff8 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:17:49 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-9a3c459f-fcbf-4292-ac47-de324b4cfff8 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:17:49 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:17:49 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=8 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:17:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9a3c459f-fcbf-4292-ac47-de324b4cfff8 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9a3c459f-fcbf-4292-ac47-de324b4cfff8 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9a3c459f-fcbf-4292-ac47-de324b4cfff8 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9a3c459f-fcbf-4292-ac47-de324b4cfff8 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9a3c459f-fcbf-4292-ac47-de324b4cfff8 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9a3c459f-fcbf-4292-ac47-de324b4cfff8 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:49 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-9a3c459f-fcbf-4292-ac47-de324b4cfff8 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.096186 Apr 13 15:17:49 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 178/528] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 15:17:49 2023] GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162/os-interface => generated 282 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:17:50 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-a0b8897b-ad8c-4200-b9a7-01cffd362989 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:17:50 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-a0b8897b-ad8c-4200-b9a7-01cffd362989 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:17:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a0b8897b-ad8c-4200-b9a7-01cffd362989 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a0b8897b-ad8c-4200-b9a7-01cffd362989 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a0b8897b-ad8c-4200-b9a7-01cffd362989 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a0b8897b-ad8c-4200-b9a7-01cffd362989 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a0b8897b-ad8c-4200-b9a7-01cffd362989 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a0b8897b-ad8c-4200-b9a7-01cffd362989 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:50 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-a0b8897b-ad8c-4200-b9a7-01cffd362989 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162/ips" status: 200 len: 108 microversion: 2.1 time: 0.049709 Apr 13 15:17:50 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 174/529] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 15:17:50 2023] GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162/ips => generated 108 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:17:50 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0953e89-df86-47d7-9d9d-a5e263476027"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:17:50 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:17:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:50 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-bf841943-f73d-428a-8282-bcc27da99eaa req-9f7b68c0-435b-4dd9-a38c-0651c6b8cb54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc146f3-9150-4920-b468-9aebcbc81162", "tag": "8f16dd83-a089-414b-9525-cc7ef42c7331"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:17:50 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-f8636ac3-f2d1-47ce-a5ca-f85289a3fdd2 req-af16465a-3a08-4f4c-8678-6f73aaca3b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:17:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-bf841943-f73d-428a-8282-bcc27da99eaa req-9f7b68c0-435b-4dd9-a38c-0651c6b8cb54 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-bf841943-f73d-428a-8282-bcc27da99eaa req-9f7b68c0-435b-4dd9-a38c-0651c6b8cb54 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-bf841943-f73d-428a-8282-bcc27da99eaa req-9f7b68c0-435b-4dd9-a38c-0651c6b8cb54 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-f8636ac3-f2d1-47ce-a5ca-f85289a3fdd2 req-af16465a-3a08-4f4c-8678-6f73aaca3b37 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-f8636ac3-f2d1-47ce-a5ca-f85289a3fdd2 req-af16465a-3a08-4f4c-8678-6f73aaca3b37 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-f8636ac3-f2d1-47ce-a5ca-f85289a3fdd2 req-af16465a-3a08-4f4c-8678-6f73aaca3b37 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:50 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-bf841943-f73d-428a-8282-bcc27da99eaa req-9f7b68c0-435b-4dd9-a38c-0651c6b8cb54 service nova] Creating event network-changed:8f16dd83-a089-414b-9525-cc7ef42c7331 for instance 3dc146f3-9150-4920-b468-9aebcbc81162 on user Apr 13 15:17:50 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-bf841943-f73d-428a-8282-bcc27da99eaa req-9f7b68c0-435b-4dd9-a38c-0651c6b8cb54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233963 Apr 13 15:17:50 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-f8636ac3-f2d1-47ce-a5ca-f85289a3fdd2 req-af16465a-3a08-4f4c-8678-6f73aaca3b37 service nova] Creating event network-changed:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:17:50 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 178/530] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:17:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:17:50 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-f8636ac3-f2d1-47ce-a5ca-f85289a3fdd2 req-af16465a-3a08-4f4c-8678-6f73aaca3b37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155725 Apr 13 15:17:50 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 179/531] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:17:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:17:51 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306943 Apr 13 15:17:51 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 175/532] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:17:50 2023] POST /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:17:53 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73467274-8e1f-4536-9458-f3e619202566"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:17:53 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:17:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:53 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317010 Apr 13 15:17:53 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 179/533] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:17:53 2023] POST /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:17:57 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1353436701"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:17:57 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:17:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:58 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "POST /compute/v2.1/servers/149f8be9-79d3-4922-b3cc-c164b8b81534/action" status: 202 len: 52 microversion: 2.87 time: 0.854957 Apr 13 15:17:58 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 180/534] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 15:17:57 2023] POST /compute/v2.1/servers/149f8be9-79d3-4922-b3cc-c164b8b81534/action => generated 52 bytes in 857 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 13 15:17:59 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:17:59 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:17:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:59 user devstack@n-api.service[61871]: DEBUG nova.objects.instance [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'flavor' on Instance uuid 8b883f51-b15c-42d7-b71a-e80c11e7d77e {{(pid=61871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:17:59 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e/action" status: 200 len: 32 microversion: 2.1 time: 0.161719 Apr 13 15:17:59 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 176/535] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:17:59 2023] POST /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:17:59 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-87169962-6526-499c-82f7-c9b2229258d0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:17:59 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-87169962-6526-499c-82f7-c9b2229258d0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:17:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-87169962-6526-499c-82f7-c9b2229258d0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-87169962-6526-499c-82f7-c9b2229258d0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-87169962-6526-499c-82f7-c9b2229258d0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-87169962-6526-499c-82f7-c9b2229258d0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:17:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-87169962-6526-499c-82f7-c9b2229258d0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:17:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-87169962-6526-499c-82f7-c9b2229258d0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:17:59 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-87169962-6526-499c-82f7-c9b2229258d0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:17:59 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-87169962-6526-499c-82f7-c9b2229258d0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e" status: 200 len: 1724 microversion: 2.1 time: 0.270228 Apr 13 15:17:59 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 180/536] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:17:59 2023] GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:18:00 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-2cdd43f3-6752-4bf4-9e5b-87657ae0fbc6 req-f6f06772-1227-473c-b06e-970a255f351d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "name": "network-vif-unplugged", "status": "completed", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:18:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-2cdd43f3-6752-4bf4-9e5b-87657ae0fbc6 req-f6f06772-1227-473c-b06e-970a255f351d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-2cdd43f3-6752-4bf4-9e5b-87657ae0fbc6 req-f6f06772-1227-473c-b06e-970a255f351d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-2cdd43f3-6752-4bf4-9e5b-87657ae0fbc6 req-f6f06772-1227-473c-b06e-970a255f351d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:00 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-2cdd43f3-6752-4bf4-9e5b-87657ae0fbc6 req-f6f06772-1227-473c-b06e-970a255f351d service nova] Creating event network-vif-unplugged:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:18:00 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-2cdd43f3-6752-4bf4-9e5b-87657ae0fbc6 req-f6f06772-1227-473c-b06e-970a255f351d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.361044 Apr 13 15:18:00 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 181/537] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:18:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:18:02 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-0d966ea8-267d-4e53-a708-8a97dac348f4 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Action: 'create', calling method: .version_select at 0x7f3a8faa7400>, body: {"keypair": {"name": "tempest-keypair-1037646861", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEhJ8aRxcbt/b5bssHKvxbi2jC4AIY4T4hBEvKmj6R/j7wnUxuzLMRkfvDY3ug4A3Z/GvYHuFzNcKE9qqa0IWiS0M7i9r1KPJSEpqF4maidOFTbDofTAAXRjfFcQzNILw=="}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:18:02 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-0d966ea8-267d-4e53-a708-8a97dac348f4 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting quotas for project 3e3ba2d132c445039d0ae30ffd2bc64a. Resources: {'key_pairs'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:18:02 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-0d966ea8-267d-4e53-a708-8a97dac348f4 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting quotas for user fedd34ccc15c47f9a4fc96b080730acd and project 3e3ba2d132c445039d0ae30ffd2bc64a. Resources: {'key_pairs'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:18:02 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-0d966ea8-267d-4e53-a708-8a97dac348f4 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044572 Apr 13 15:18:02 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 177/538] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 15:18:02 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:18:02 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-0595d2a4-a37e-4f76-a1d3-bb04ce4b95a8 req-96da7d1f-50d4-43da-a1a4-aad2e452e22f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "name": "network-vif-plugged", "status": "completed", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:18:02 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-0595d2a4-a37e-4f76-a1d3-bb04ce4b95a8 req-96da7d1f-50d4-43da-a1a4-aad2e452e22f service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:02 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-0595d2a4-a37e-4f76-a1d3-bb04ce4b95a8 req-96da7d1f-50d4-43da-a1a4-aad2e452e22f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:02 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-0595d2a4-a37e-4f76-a1d3-bb04ce4b95a8 req-96da7d1f-50d4-43da-a1a4-aad2e452e22f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:02 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-0595d2a4-a37e-4f76-a1d3-bb04ce4b95a8 req-96da7d1f-50d4-43da-a1a4-aad2e452e22f service nova] Creating event network-vif-plugged:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:18:02 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-0595d2a4-a37e-4f76-a1d3-bb04ce4b95a8 req-96da7d1f-50d4-43da-a1a4-aad2e452e22f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031274 Apr 13 15:18:02 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 181/539] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:18:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:18:03 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-eff6384b-bab6-49dc-9d9a-16ff44b4e820 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:18:03 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-eff6384b-bab6-49dc-9d9a-16ff44b4e820 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:18:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-eff6384b-bab6-49dc-9d9a-16ff44b4e820 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-eff6384b-bab6-49dc-9d9a-16ff44b4e820 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-eff6384b-bab6-49dc-9d9a-16ff44b4e820 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-eff6384b-bab6-49dc-9d9a-16ff44b4e820 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-eff6384b-bab6-49dc-9d9a-16ff44b4e820 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-eff6384b-bab6-49dc-9d9a-16ff44b4e820 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:04 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-eff6384b-bab6-49dc-9d9a-16ff44b4e820 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:18:04 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-eff6384b-bab6-49dc-9d9a-16ff44b4e820 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:18:04 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-eff6384b-bab6-49dc-9d9a-16ff44b4e820 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:18:04 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-eff6384b-bab6-49dc-9d9a-16ff44b4e820 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/149f8be9-79d3-4922-b3cc-c164b8b81534" status: 200 len: 1690 microversion: 2.87 time: 0.196967 Apr 13 15:18:04 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 182/540] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:18:03 2023] GET /compute/v2.1/servers/149f8be9-79d3-4922-b3cc-c164b8b81534 => generated 1690 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:18:04 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-610975501", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "547bb22a-22b3-4b8b-ab87-e4eb4af27619"}], "security_groups": [{"name": "tempest-securitygroup--339829963"}], "key_name": "tempest-keypair-1037646861", "user_data": "}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:18:04 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] validate_networks() for [('547bb22a-22b3-4b8b-ab87-e4eb4af27619', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:18:04 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-90dea0df-8978-48a7-a23c-cd551308e5ca req-7c50212a-42b8-4e94-a500-bfb5b093d7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "name": "network-vif-plugged", "status": "completed", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}, {"server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "name": "network-vif-plugged", "status": "completed", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:18:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-90dea0df-8978-48a7-a23c-cd551308e5ca req-7c50212a-42b8-4e94-a500-bfb5b093d7d5 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-90dea0df-8978-48a7-a23c-cd551308e5ca req-7c50212a-42b8-4e94-a500-bfb5b093d7d5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-90dea0df-8978-48a7-a23c-cd551308e5ca req-7c50212a-42b8-4e94-a500-bfb5b093d7d5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:04 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-90dea0df-8978-48a7-a23c-cd551308e5ca req-7c50212a-42b8-4e94-a500-bfb5b093d7d5 service nova] Creating event network-vif-plugged:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:18:04 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-90dea0df-8978-48a7-a23c-cd551308e5ca req-7c50212a-42b8-4e94-a500-bfb5b093d7d5 service nova] Creating event network-vif-plugged:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:18:04 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-90dea0df-8978-48a7-a23c-cd551308e5ca req-7c50212a-42b8-4e94-a500-bfb5b093d7d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032010 Apr 13 15:18:04 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 182/541] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:18:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:18:04 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:18:04 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:18:04 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:18:04 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:18:04 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:18:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:04 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting quotas for project 3e3ba2d132c445039d0ae30ffd2bc64a. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:18:04 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting quotas for user fedd34ccc15c47f9a4fc96b080730acd and project 3e3ba2d132c445039d0ae30ffd2bc64a. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:18:04 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:18:04 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:18:04 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.668693 Apr 13 15:18:04 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 178/542] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:18:04 2023] POST /compute/v2.1/servers => generated 399 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:18:04 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-b4b4661e-cc5f-4dfe-bc3d-9f896f731ca0 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:18:04 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-b4b4661e-cc5f-4dfe-bc3d-9f896f731ca0 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:18:04 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-b4b4661e-cc5f-4dfe-bc3d-9f896f731ca0 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedd34ccc15c47f9a4fc96b080730acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3ba2d132c445039d0ae30ffd2bc64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:18:05 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-b4b4661e-cc5f-4dfe-bc3d-9f896f731ca0 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5" status: 200 len: 1235 microversion: 2.1 time: 0.065734 Apr 13 15:18:05 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 183/543] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:18:04 2023] GET /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5 => generated 1235 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:18:07 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-74d0f7c4-cdca-4043-b647-91227fdaa063 req-9036e91d-fd82-4454-9223-fb008260882a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77237c63-ee05-45ee-b9d7-a79deb5557d5", "tag": "69f51766-5253-402e-8928-e02e0636e8fb"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:18:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-74d0f7c4-cdca-4043-b647-91227fdaa063 req-9036e91d-fd82-4454-9223-fb008260882a service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-74d0f7c4-cdca-4043-b647-91227fdaa063 req-9036e91d-fd82-4454-9223-fb008260882a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-74d0f7c4-cdca-4043-b647-91227fdaa063 req-9036e91d-fd82-4454-9223-fb008260882a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:07 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-74d0f7c4-cdca-4043-b647-91227fdaa063 req-9036e91d-fd82-4454-9223-fb008260882a service nova] Creating event network-changed:69f51766-5253-402e-8928-e02e0636e8fb for instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 on user Apr 13 15:18:07 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-74d0f7c4-cdca-4043-b647-91227fdaa063 req-9036e91d-fd82-4454-9223-fb008260882a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029754 Apr 13 15:18:07 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 183/544] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:18:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:18:10 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-7259095d-4535-4522-acfe-991221818989 req-ed4d7af5-6277-42a1-9a93-73ac880baf2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77237c63-ee05-45ee-b9d7-a79deb5557d5", "name": "network-vif-plugged", "status": "completed", "tag": "69f51766-5253-402e-8928-e02e0636e8fb"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:18:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-7259095d-4535-4522-acfe-991221818989 req-ed4d7af5-6277-42a1-9a93-73ac880baf2b service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-7259095d-4535-4522-acfe-991221818989 req-ed4d7af5-6277-42a1-9a93-73ac880baf2b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-7259095d-4535-4522-acfe-991221818989 req-ed4d7af5-6277-42a1-9a93-73ac880baf2b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:10 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-7259095d-4535-4522-acfe-991221818989 req-ed4d7af5-6277-42a1-9a93-73ac880baf2b service nova] Creating event network-vif-plugged:69f51766-5253-402e-8928-e02e0636e8fb for instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 on user Apr 13 15:18:10 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-7259095d-4535-4522-acfe-991221818989 req-ed4d7af5-6277-42a1-9a93-73ac880baf2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042515 Apr 13 15:18:10 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 179/545] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:18:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:18:12 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-6ca98496-0b32-4d7c-988b-c1957cec8788 req-0945d403-59a8-4a3d-b465-ad9f3a350ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77237c63-ee05-45ee-b9d7-a79deb5557d5", "name": "network-vif-plugged", "status": "completed", "tag": "69f51766-5253-402e-8928-e02e0636e8fb"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:18:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-6ca98496-0b32-4d7c-988b-c1957cec8788 req-0945d403-59a8-4a3d-b465-ad9f3a350ed7 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-6ca98496-0b32-4d7c-988b-c1957cec8788 req-0945d403-59a8-4a3d-b465-ad9f3a350ed7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-6ca98496-0b32-4d7c-988b-c1957cec8788 req-0945d403-59a8-4a3d-b465-ad9f3a350ed7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:12 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-6ca98496-0b32-4d7c-988b-c1957cec8788 req-0945d403-59a8-4a3d-b465-ad9f3a350ed7 service nova] Creating event network-vif-plugged:69f51766-5253-402e-8928-e02e0636e8fb for instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 on user Apr 13 15:18:12 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-6ca98496-0b32-4d7c-988b-c1957cec8788 req-0945d403-59a8-4a3d-b465-ad9f3a350ed7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031346 Apr 13 15:18:12 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 184/546] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:18:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:18:27 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=14 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:18:27 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:18:27 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:18:27 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:18:27 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:27 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:27 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:27 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:27 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:27 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:27 user devstack@n-api.service[61872]: DEBUG nova.objects.instance [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'services' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=61872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:18:27 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:18:27 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=10 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:18:27 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:18:27 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:18:27 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:18:27 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:18:27 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:27 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3/os-volume_attachments/833def22-5680-4c24-9368-2130eefccdfc" status: 202 len: 0 microversion: 2.1 time: 0.426651 Apr 13 15:18:27 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:27 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:27 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 184/547] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:18:27 2023] DELETE /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3/os-volume_attachments/833def22-5680-4c24-9368-2130eefccdfc => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:18:27 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:27 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:27 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:27 user devstack@n-api.service[61871]: DEBUG nova.objects.instance [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'services' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=61871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:18:27 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/os-volume_attachments/f88a0575-31ac-45a6-a221-4fc8001fd857" status: 202 len: 0 microversion: 2.1 time: 0.190096 Apr 13 15:18:27 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 180/548] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:18:27 2023] DELETE /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/os-volume_attachments/f88a0575-31ac-45a6-a221-4fc8001fd857 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:18:27 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:18:27 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=18 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:18:27 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:18:27 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-351794fc-9db9-4d43-8a16-6fafd17d53cb tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:18:27 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-351794fc-9db9-4d43-8a16-6fafd17d53cb tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:18:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-351794fc-9db9-4d43-8a16-6fafd17d53cb tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-351794fc-9db9-4d43-8a16-6fafd17d53cb tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-351794fc-9db9-4d43-8a16-6fafd17d53cb tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-351794fc-9db9-4d43-8a16-6fafd17d53cb tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-351794fc-9db9-4d43-8a16-6fafd17d53cb tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:27 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-351794fc-9db9-4d43-8a16-6fafd17d53cb tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:27 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-351794fc-9db9-4d43-8a16-6fafd17d53cb tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067255 Apr 13 15:18:27 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 185/549] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:18:27 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:18:29 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-cd789df6-0461-40e2-8510-a0a0d78b2fe8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:18:29 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cd789df6-0461-40e2-8510-a0a0d78b2fe8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:29 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cd789df6-0461-40e2-8510-a0a0d78b2fe8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:29 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cd789df6-0461-40e2-8510-a0a0d78b2fe8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:29 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-cd789df6-0461-40e2-8510-a0a0d78b2fe8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Going to try to stop instance {{(pid=61872) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 13 15:18:29 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-cd789df6-0461-40e2-8510-a0a0d78b2fe8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3/action" status: 202 len: 0 microversion: 2.1 time: 0.101231 Apr 13 15:18:29 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 185/550] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:18:29 2023] POST /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 15:18:29 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-2e4a5e12-d93e-4667-b91e-c521d92feeeb tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:18:29 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-2e4a5e12-d93e-4667-b91e-c521d92feeeb tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:18:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2e4a5e12-d93e-4667-b91e-c521d92feeeb tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2e4a5e12-d93e-4667-b91e-c521d92feeeb tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2e4a5e12-d93e-4667-b91e-c521d92feeeb tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2e4a5e12-d93e-4667-b91e-c521d92feeeb tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2e4a5e12-d93e-4667-b91e-c521d92feeeb tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2e4a5e12-d93e-4667-b91e-c521d92feeeb tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:30 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-2e4a5e12-d93e-4667-b91e-c521d92feeeb tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1a698b103a47c0b2864eef54be648b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceba33821a9b4f7aa81c2857c11261f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:18:30 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-2e4a5e12-d93e-4667-b91e-c521d92feeeb tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3" status: 200 len: 1664 microversion: 2.1 time: 0.171823 Apr 13 15:18:30 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 181/551] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:18:29 2023] GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3 => generated 1664 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:18:30 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-511052a0-583d-49eb-94e0-a6ac7df6a804 req-4c878f97-8f26-4e7f-a268-ec386ad329f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa74d14-db6f-41f5-b8af-32da312209d3", "name": "network-vif-unplugged", "status": "completed", "tag": "84611f06-d6ca-49e1-afe7-7723921e62dc"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:18:30 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-511052a0-583d-49eb-94e0-a6ac7df6a804 req-4c878f97-8f26-4e7f-a268-ec386ad329f5 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:30 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-511052a0-583d-49eb-94e0-a6ac7df6a804 req-4c878f97-8f26-4e7f-a268-ec386ad329f5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:30 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-511052a0-583d-49eb-94e0-a6ac7df6a804 req-4c878f97-8f26-4e7f-a268-ec386ad329f5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:30 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-511052a0-583d-49eb-94e0-a6ac7df6a804 req-4c878f97-8f26-4e7f-a268-ec386ad329f5 service nova] Creating event network-vif-unplugged:84611f06-d6ca-49e1-afe7-7723921e62dc for instance 1aa74d14-db6f-41f5-b8af-32da312209d3 on user Apr 13 15:18:30 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-511052a0-583d-49eb-94e0-a6ac7df6a804 req-4c878f97-8f26-4e7f-a268-ec386ad329f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032151 Apr 13 15:18:30 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 186/552] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:18:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:18:32 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-4c88313f-0f3f-421b-b21a-f392cee0b02c req-8e6c3502-b28e-4777-9151-d18a98b7eb76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa74d14-db6f-41f5-b8af-32da312209d3", "name": "network-vif-plugged", "status": "completed", "tag": "84611f06-d6ca-49e1-afe7-7723921e62dc"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:18:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-4c88313f-0f3f-421b-b21a-f392cee0b02c req-8e6c3502-b28e-4777-9151-d18a98b7eb76 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-4c88313f-0f3f-421b-b21a-f392cee0b02c req-8e6c3502-b28e-4777-9151-d18a98b7eb76 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-4c88313f-0f3f-421b-b21a-f392cee0b02c req-8e6c3502-b28e-4777-9151-d18a98b7eb76 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:32 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-4c88313f-0f3f-421b-b21a-f392cee0b02c req-8e6c3502-b28e-4777-9151-d18a98b7eb76 service nova] Creating event network-vif-plugged:84611f06-d6ca-49e1-afe7-7723921e62dc for instance 1aa74d14-db6f-41f5-b8af-32da312209d3 on user Apr 13 15:18:32 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-4c88313f-0f3f-421b-b21a-f392cee0b02c req-8e6c3502-b28e-4777-9151-d18a98b7eb76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045934 Apr 13 15:18:32 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 186/553] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:18:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:18:48 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-30a84bdc-71ef-4739-922d-601f189cd098 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:18:48 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-30a84bdc-71ef-4739-922d-601f189cd098 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:18:48 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=4 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:18:48 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:18:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-30a84bdc-71ef-4739-922d-601f189cd098 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-30a84bdc-71ef-4739-922d-601f189cd098 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-30a84bdc-71ef-4739-922d-601f189cd098 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-30a84bdc-71ef-4739-922d-601f189cd098 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-30a84bdc-71ef-4739-922d-601f189cd098 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-30a84bdc-71ef-4739-922d-601f189cd098 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:48 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-30a84bdc-71ef-4739-922d-601f189cd098 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:18:48 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-30a84bdc-71ef-4739-922d-601f189cd098 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" status: 200 len: 1535 microversion: 2.1 time: 0.160770 Apr 13 15:18:48 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 182/554] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:18:48 2023] GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe => generated 1535 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:18:48 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-d18b3a75-c681-42bd-a185-3bb47a40578c tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:18:48 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-d18b3a75-c681-42bd-a185-3bb47a40578c tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:18:48 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-d18b3a75-c681-42bd-a185-3bb47a40578c tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Searching by: {'deleted': False, 'project_id': '738150b0ec0c4ce887397f161c7e8c21'} {{(pid=61873) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 13 15:18:48 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:18:48 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=8 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:18:48 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d18b3a75-c681-42bd-a185-3bb47a40578c tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:48 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d18b3a75-c681-42bd-a185-3bb47a40578c tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:48 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d18b3a75-c681-42bd-a185-3bb47a40578c tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:48 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d18b3a75-c681-42bd-a185-3bb47a40578c tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:48 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d18b3a75-c681-42bd-a185-3bb47a40578c tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:48 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d18b3a75-c681-42bd-a185-3bb47a40578c tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:48 user devstack@n-api.service[61873]: DEBUG nova.compute.multi_cell_list [None req-d18b3a75-c681-42bd-a185-3bb47a40578c tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61873) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 13 15:18:48 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-d18b3a75-c681-42bd-a185-3bb47a40578c tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.158922 Apr 13 15:18:48 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 187/555] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 13 15:18:48 2023] GET /compute/v2.1/servers => generated 340 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:18:48 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:18:48 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:18:48 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-f7e56a5c-514e-412f-b04e-e6b1084823ca tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:18:48 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-f7e56a5c-514e-412f-b04e-e6b1084823ca tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:18:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f7e56a5c-514e-412f-b04e-e6b1084823ca tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f7e56a5c-514e-412f-b04e-e6b1084823ca tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f7e56a5c-514e-412f-b04e-e6b1084823ca tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f7e56a5c-514e-412f-b04e-e6b1084823ca tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f7e56a5c-514e-412f-b04e-e6b1084823ca tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f7e56a5c-514e-412f-b04e-e6b1084823ca tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:49 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-f7e56a5c-514e-412f-b04e-e6b1084823ca tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:18:49 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-f7e56a5c-514e-412f-b04e-e6b1084823ca tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" status: 200 len: 1535 microversion: 2.1 time: 0.153783 Apr 13 15:18:49 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 187/556] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:18:48 2023] GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe => generated 1535 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:18:49 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-f94f0f27-8051-47ed-86d0-a0be12c5461a tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:18:49 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-f94f0f27-8051-47ed-86d0-a0be12c5461a tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:18:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f94f0f27-8051-47ed-86d0-a0be12c5461a tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f94f0f27-8051-47ed-86d0-a0be12c5461a tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f94f0f27-8051-47ed-86d0-a0be12c5461a tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f94f0f27-8051-47ed-86d0-a0be12c5461a tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f94f0f27-8051-47ed-86d0-a0be12c5461a tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f94f0f27-8051-47ed-86d0-a0be12c5461a tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:49 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-f94f0f27-8051-47ed-86d0-a0be12c5461a tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:18:49 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-f94f0f27-8051-47ed-86d0-a0be12c5461a tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e" status: 200 len: 1704 microversion: 2.1 time: 0.377526 Apr 13 15:18:49 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 183/557] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:18:49 2023] GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e => generated 1704 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:18:50 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11a7881b-efa3-43da-9fd0-3e26df187b17"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:18:50 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:18:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:51 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307428 Apr 13 15:18:51 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 188/558] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:18:50 2023] POST /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:18:55 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-fa2330d8-6138-456f-a918-790ed32cef07 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:18:55 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-fa2330d8-6138-456f-a918-790ed32cef07 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:18:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-fa2330d8-6138-456f-a918-790ed32cef07 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-fa2330d8-6138-456f-a918-790ed32cef07 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-fa2330d8-6138-456f-a918-790ed32cef07 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-fa2330d8-6138-456f-a918-790ed32cef07 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-fa2330d8-6138-456f-a918-790ed32cef07 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-fa2330d8-6138-456f-a918-790ed32cef07 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:55 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-fa2330d8-6138-456f-a918-790ed32cef07 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedd34ccc15c47f9a4fc96b080730acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3ba2d132c445039d0ae30ffd2bc64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:18:55 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-fa2330d8-6138-456f-a918-790ed32cef07 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5" status: 200 len: 1544 microversion: 2.1 time: 0.145163 Apr 13 15:18:55 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 188/559] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:18:55 2023] GET /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5 => generated 1544 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:18:57 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-a85c1faf-2b8d-4f54-9b7d-93ed36d558cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:18:57 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-a85c1faf-2b8d-4f54-9b7d-93ed36d558cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:18:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a85c1faf-2b8d-4f54-9b7d-93ed36d558cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a85c1faf-2b8d-4f54-9b7d-93ed36d558cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a85c1faf-2b8d-4f54-9b7d-93ed36d558cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a85c1faf-2b8d-4f54-9b7d-93ed36d558cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:18:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a85c1faf-2b8d-4f54-9b7d-93ed36d558cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:18:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a85c1faf-2b8d-4f54-9b7d-93ed36d558cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:18:57 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-a85c1faf-2b8d-4f54-9b7d-93ed36d558cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:18:57 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-a85c1faf-2b8d-4f54-9b7d-93ed36d558cf tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" status: 200 len: 1581 microversion: 2.1 time: 0.210406 Apr 13 15:18:57 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 184/560] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:18:57 2023] GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe => generated 1581 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:19:00 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:19:00 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-d9b261ba-b3d5-4025-a106-42bac3fd4330 req-399cb4e4-91a9-4040-aa28-1e66b196c56f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe", "tag": "df99421e-bdc6-4fe5-9865-823bcb128ccc"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:19:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d9b261ba-b3d5-4025-a106-42bac3fd4330 req-399cb4e4-91a9-4040-aa28-1e66b196c56f service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d9b261ba-b3d5-4025-a106-42bac3fd4330 req-399cb4e4-91a9-4040-aa28-1e66b196c56f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d9b261ba-b3d5-4025-a106-42bac3fd4330 req-399cb4e4-91a9-4040-aa28-1e66b196c56f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:00 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-d9b261ba-b3d5-4025-a106-42bac3fd4330 req-399cb4e4-91a9-4040-aa28-1e66b196c56f service nova] Creating event network-changed:df99421e-bdc6-4fe5-9865-823bcb128ccc for instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe on user Apr 13 15:19:00 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-d9b261ba-b3d5-4025-a106-42bac3fd4330 req-399cb4e4-91a9-4040-aa28-1e66b196c56f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033679 Apr 13 15:19:00 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 189/561] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:19:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:19:01 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-ef2bf820-eb16-425d-a2c9-63710fbb2606 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-809205949"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:19:01 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-ef2bf820-eb16-425d-a2c9-63710fbb2606 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ef2bf820-eb16-425d-a2c9-63710fbb2606 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ef2bf820-eb16-425d-a2c9-63710fbb2606 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ef2bf820-eb16-425d-a2c9-63710fbb2606 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ef2bf820-eb16-425d-a2c9-63710fbb2606 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ef2bf820-eb16-425d-a2c9-63710fbb2606 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ef2bf820-eb16-425d-a2c9-63710fbb2606 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:01 user devstack@n-api.service[61872]: INFO nova.network.security_group_api [None req-ef2bf820-eb16-425d-a2c9-63710fbb2606 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Adding security group ef644a5d-06dc-43f6-9f9c-0f3e22b2f58b to port df99421e-bdc6-4fe5-9865-823bcb128ccc Apr 13 15:19:02 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-ef2bf820-eb16-425d-a2c9-63710fbb2606 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/action" status: 202 len: 0 microversion: 2.1 time: 0.717578 Apr 13 15:19:02 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 189/562] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:19:01 2023] POST /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/action => generated 0 bytes in 719 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:19:02 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-f24dbfc4-c5af-4494-9ade-d575cadfac7e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:19:02 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-f24dbfc4-c5af-4494-9ade-d575cadfac7e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:02 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-388e0382-42c3-43af-be7c-c5118c31b879 req-d96697ee-fcc3-4f6e-869b-fd058401ba9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe", "tag": "df99421e-bdc6-4fe5-9865-823bcb128ccc"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:19:02 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f24dbfc4-c5af-4494-9ade-d575cadfac7e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:02 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f24dbfc4-c5af-4494-9ade-d575cadfac7e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:02 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f24dbfc4-c5af-4494-9ade-d575cadfac7e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:02 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f24dbfc4-c5af-4494-9ade-d575cadfac7e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:02 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f24dbfc4-c5af-4494-9ade-d575cadfac7e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:02 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f24dbfc4-c5af-4494-9ade-d575cadfac7e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-388e0382-42c3-43af-be7c-c5118c31b879 req-d96697ee-fcc3-4f6e-869b-fd058401ba9d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-388e0382-42c3-43af-be7c-c5118c31b879 req-d96697ee-fcc3-4f6e-869b-fd058401ba9d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-388e0382-42c3-43af-be7c-c5118c31b879 req-d96697ee-fcc3-4f6e-869b-fd058401ba9d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:02 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-388e0382-42c3-43af-be7c-c5118c31b879 req-d96697ee-fcc3-4f6e-869b-fd058401ba9d service nova] Creating event network-changed:df99421e-bdc6-4fe5-9865-823bcb128ccc for instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe on user Apr 13 15:19:02 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-388e0382-42c3-43af-be7c-c5118c31b879 req-d96697ee-fcc3-4f6e-869b-fd058401ba9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030200 Apr 13 15:19:02 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 190/563] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:19:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:19:02 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-f24dbfc4-c5af-4494-9ade-d575cadfac7e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:19:02 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-f24dbfc4-c5af-4494-9ade-d575cadfac7e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" status: 200 len: 1746 microversion: 2.1 time: 0.174544 Apr 13 15:19:02 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 185/564] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:19:02 2023] GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe => generated 1746 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:19:02 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:19:02 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:02 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:02 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:02 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:02 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:02 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:02 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:02 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/action" status: 202 len: 0 microversion: 2.1 time: 0.102631 Apr 13 15:19:02 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 190/565] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:19:02 2023] POST /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:19:02 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-e930b171-2b3b-4489-abdb-baee1cdc6d76 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:19:02 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-e930b171-2b3b-4489-abdb-baee1cdc6d76 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e930b171-2b3b-4489-abdb-baee1cdc6d76 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e930b171-2b3b-4489-abdb-baee1cdc6d76 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e930b171-2b3b-4489-abdb-baee1cdc6d76 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e930b171-2b3b-4489-abdb-baee1cdc6d76 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e930b171-2b3b-4489-abdb-baee1cdc6d76 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e930b171-2b3b-4489-abdb-baee1cdc6d76 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:02 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-e930b171-2b3b-4489-abdb-baee1cdc6d76 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:19:02 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-e930b171-2b3b-4489-abdb-baee1cdc6d76 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" status: 200 len: 1738 microversion: 2.1 time: 0.268013 Apr 13 15:19:02 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 191/566] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:19:02 2023] GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe => generated 1738 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:19:04 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-82933329", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "destination_type": "volume"}], "networks": [{"uuid": "928c080b-0ead-4f65-85b3-2c98a7549dbb"}]}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:19:04 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] validate_networks() for [('928c080b-0ead-4f65-85b3-2c98a7549dbb', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:19:04 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:19:04 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:19:04 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:19:04 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:19:04 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:19:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:04 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Getting quotas for project 240b28f42732478ba732994b2c9e3fbe. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:19:04 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Getting quotas for user 75bf6e19993f4c2e90fd52c4d6212622 and project 240b28f42732478ba732994b2c9e3fbe. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:19:04 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:19:04 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:19:04 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.603763 Apr 13 15:19:04 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 186/567] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 15:19:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 15:19:04 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-c815bdb8-855b-490e-ac9b-a0d2665ca910 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:19:04 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-c815bdb8-855b-490e-ac9b-a0d2665ca910 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:04 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-c815bdb8-855b-490e-ac9b-a0d2665ca910 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:19:04 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-c815bdb8-855b-490e-ac9b-a0d2665ca910 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:19:04 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-c815bdb8-855b-490e-ac9b-a0d2665ca910 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:19:04 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-c815bdb8-855b-490e-ac9b-a0d2665ca910 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f" status: 200 len: 1393 microversion: 2.87 time: 0.084659 Apr 13 15:19:04 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 191/568] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:19:04 2023] GET /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f => generated 1393 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:19:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-026d8082-7ca2-4bbf-9a2a-254ff68331e3 req-c8f43367-71aa-42c3-8743-61b28ba79eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe", "name": "network-vif-unplugged", "status": "completed", "tag": "df99421e-bdc6-4fe5-9865-823bcb128ccc"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:19:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-026d8082-7ca2-4bbf-9a2a-254ff68331e3 req-c8f43367-71aa-42c3-8743-61b28ba79eba service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-026d8082-7ca2-4bbf-9a2a-254ff68331e3 req-c8f43367-71aa-42c3-8743-61b28ba79eba service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-026d8082-7ca2-4bbf-9a2a-254ff68331e3 req-c8f43367-71aa-42c3-8743-61b28ba79eba service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:05 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-026d8082-7ca2-4bbf-9a2a-254ff68331e3 req-c8f43367-71aa-42c3-8743-61b28ba79eba service nova] Creating event network-vif-unplugged:df99421e-bdc6-4fe5-9865-823bcb128ccc for instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe on user Apr 13 15:19:05 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-026d8082-7ca2-4bbf-9a2a-254ff68331e3 req-c8f43367-71aa-42c3-8743-61b28ba79eba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029216 Apr 13 15:19:05 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 192/569] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:19:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:19:07 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe", "name": "network-vif-plugged", "status": "completed", "tag": "df99421e-bdc6-4fe5-9865-823bcb128ccc"}, {"name": "network-changed", "server_uuid": "c609c1d1-edcf-4b71-abea-5dd95ebcd81f", "tag": "92d492eb-f3b6-4481-b492-949cf7eabd1a"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:19:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:07 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] Creating event network-vif-plugged:df99421e-bdc6-4fe5-9865-823bcb128ccc for instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe on user Apr 13 15:19:07 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] Creating event network-changed:92d492eb-f3b6-4481-b492-949cf7eabd1a for instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f on user Apr 13 15:19:07 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.038090 Apr 13 15:19:07 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 187/570] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:19:07 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:19:09 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-f066af64-015a-4e6c-b691-f2c202e1314b req-0aff2a9e-ed54-4ef7-a28e-b76af598b2ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe", "name": "network-vif-plugged", "status": "completed", "tag": "df99421e-bdc6-4fe5-9865-823bcb128ccc"}, {"server_uuid": "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe", "name": "network-vif-plugged", "status": "completed", "tag": "df99421e-bdc6-4fe5-9865-823bcb128ccc"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:19:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f066af64-015a-4e6c-b691-f2c202e1314b req-0aff2a9e-ed54-4ef7-a28e-b76af598b2ba service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f066af64-015a-4e6c-b691-f2c202e1314b req-0aff2a9e-ed54-4ef7-a28e-b76af598b2ba service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f066af64-015a-4e6c-b691-f2c202e1314b req-0aff2a9e-ed54-4ef7-a28e-b76af598b2ba service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:09 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-f066af64-015a-4e6c-b691-f2c202e1314b req-0aff2a9e-ed54-4ef7-a28e-b76af598b2ba service nova] Creating event network-vif-plugged:df99421e-bdc6-4fe5-9865-823bcb128ccc for instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe on user Apr 13 15:19:09 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-f066af64-015a-4e6c-b691-f2c202e1314b req-0aff2a9e-ed54-4ef7-a28e-b76af598b2ba service nova] Creating event network-vif-plugged:df99421e-bdc6-4fe5-9865-823bcb128ccc for instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe on user Apr 13 15:19:09 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-f066af64-015a-4e6c-b691-f2c202e1314b req-0aff2a9e-ed54-4ef7-a28e-b76af598b2ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036747 Apr 13 15:19:09 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 192/571] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:19:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:19:17 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=12 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:19:17 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:19:17 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-4e8cd71d-58d6-48da-a529-5b46f952b9cf tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:19:17 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-4e8cd71d-58d6-48da-a529-5b46f952b9cf tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4e8cd71d-58d6-48da-a529-5b46f952b9cf tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4e8cd71d-58d6-48da-a529-5b46f952b9cf tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4e8cd71d-58d6-48da-a529-5b46f952b9cf tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4e8cd71d-58d6-48da-a529-5b46f952b9cf tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4e8cd71d-58d6-48da-a529-5b46f952b9cf tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4e8cd71d-58d6-48da-a529-5b46f952b9cf tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:17 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-4e8cd71d-58d6-48da-a529-5b46f952b9cf tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060497 Apr 13 15:19:17 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 193/572] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:19:17 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:19:17 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:19:17 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:19:17 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:19:17 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=28 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:19:18 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-f60a7a66-b8ba-4c3f-aa0a-a0fa7822141d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:19:18 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-f60a7a66-b8ba-4c3f-aa0a-a0fa7822141d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f60a7a66-b8ba-4c3f-aa0a-a0fa7822141d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f60a7a66-b8ba-4c3f-aa0a-a0fa7822141d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f60a7a66-b8ba-4c3f-aa0a-a0fa7822141d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f60a7a66-b8ba-4c3f-aa0a-a0fa7822141d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f60a7a66-b8ba-4c3f-aa0a-a0fa7822141d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f60a7a66-b8ba-4c3f-aa0a-a0fa7822141d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:18 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-f60a7a66-b8ba-4c3f-aa0a-a0fa7822141d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:19:18 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-f60a7a66-b8ba-4c3f-aa0a-a0fa7822141d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1676 microversion: 2.1 time: 0.303581 Apr 13 15:19:18 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 188/573] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:19:17 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1676 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:19:18 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:19:18 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-6c9f1df3-935c-4918-954b-60d5455e3875 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:19:18 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-6c9f1df3-935c-4918-954b-60d5455e3875 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6c9f1df3-935c-4918-954b-60d5455e3875 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6c9f1df3-935c-4918-954b-60d5455e3875 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6c9f1df3-935c-4918-954b-60d5455e3875 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6c9f1df3-935c-4918-954b-60d5455e3875 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6c9f1df3-935c-4918-954b-60d5455e3875 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6c9f1df3-935c-4918-954b-60d5455e3875 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:18 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-6c9f1df3-935c-4918-954b-60d5455e3875 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:19:18 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-6c9f1df3-935c-4918-954b-60d5455e3875 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1676 microversion: 2.1 time: 0.160774 Apr 13 15:19:18 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 193/574] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:19:18 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:19:18 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-cab6309b-1c41-45d2-8848-815bd31750c2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:19:18 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-cab6309b-1c41-45d2-8848-815bd31750c2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cab6309b-1c41-45d2-8848-815bd31750c2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cab6309b-1c41-45d2-8848-815bd31750c2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cab6309b-1c41-45d2-8848-815bd31750c2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cab6309b-1c41-45d2-8848-815bd31750c2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cab6309b-1c41-45d2-8848-815bd31750c2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cab6309b-1c41-45d2-8848-815bd31750c2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:18 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-cab6309b-1c41-45d2-8848-815bd31750c2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:19:18 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-cab6309b-1c41-45d2-8848-815bd31750c2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1676 microversion: 2.1 time: 0.195390 Apr 13 15:19:18 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 194/575] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:19:18 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1676 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:19:19 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-30ebdc90-9667-4361-988b-6f26f4ad4b2c req-9c28a7c9-2e12-4700-9a08-046fcb0a1e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c609c1d1-edcf-4b71-abea-5dd95ebcd81f", "name": "network-vif-plugged", "status": "completed", "tag": "92d492eb-f3b6-4481-b492-949cf7eabd1a"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:19:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-30ebdc90-9667-4361-988b-6f26f4ad4b2c req-9c28a7c9-2e12-4700-9a08-046fcb0a1e6a service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-30ebdc90-9667-4361-988b-6f26f4ad4b2c req-9c28a7c9-2e12-4700-9a08-046fcb0a1e6a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-30ebdc90-9667-4361-988b-6f26f4ad4b2c req-9c28a7c9-2e12-4700-9a08-046fcb0a1e6a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:19 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-30ebdc90-9667-4361-988b-6f26f4ad4b2c req-9c28a7c9-2e12-4700-9a08-046fcb0a1e6a service nova] Creating event network-vif-plugged:92d492eb-f3b6-4481-b492-949cf7eabd1a for instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f on user Apr 13 15:19:19 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-30ebdc90-9667-4361-988b-6f26f4ad4b2c req-9c28a7c9-2e12-4700-9a08-046fcb0a1e6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032614 Apr 13 15:19:19 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 189/576] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:19:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:19:20 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-69450078-6930-4c1b-8b80-e0b10ba137bf tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:19:20 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-69450078-6930-4c1b-8b80-e0b10ba137bf tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:20 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=19 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:19:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-69450078-6930-4c1b-8b80-e0b10ba137bf tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-69450078-6930-4c1b-8b80-e0b10ba137bf tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-69450078-6930-4c1b-8b80-e0b10ba137bf tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-69450078-6930-4c1b-8b80-e0b10ba137bf tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-69450078-6930-4c1b-8b80-e0b10ba137bf tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-69450078-6930-4c1b-8b80-e0b10ba137bf tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:20 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:19:20 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-69450078-6930-4c1b-8b80-e0b10ba137bf tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1a698b103a47c0b2864eef54be648b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceba33821a9b4f7aa81c2857c11261f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:19:20 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-69450078-6930-4c1b-8b80-e0b10ba137bf tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3" status: 200 len: 1641 microversion: 2.1 time: 0.151032 Apr 13 15:19:20 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 194/577] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:19:20 2023] GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3 => generated 1641 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:19:21 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-705c3c65-37e4-44e9-929b-0236a928f65e req-c1e0a4ef-3187-4b89-a827-5e6f64ee1366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c609c1d1-edcf-4b71-abea-5dd95ebcd81f", "name": "network-vif-plugged", "status": "completed", "tag": "92d492eb-f3b6-4481-b492-949cf7eabd1a"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:19:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-705c3c65-37e4-44e9-929b-0236a928f65e req-c1e0a4ef-3187-4b89-a827-5e6f64ee1366 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-705c3c65-37e4-44e9-929b-0236a928f65e req-c1e0a4ef-3187-4b89-a827-5e6f64ee1366 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-705c3c65-37e4-44e9-929b-0236a928f65e req-c1e0a4ef-3187-4b89-a827-5e6f64ee1366 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:21 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-705c3c65-37e4-44e9-929b-0236a928f65e req-c1e0a4ef-3187-4b89-a827-5e6f64ee1366 service nova] Creating event network-vif-plugged:92d492eb-f3b6-4481-b492-949cf7eabd1a for instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f on user Apr 13 15:19:21 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-705c3c65-37e4-44e9-929b-0236a928f65e req-c1e0a4ef-3187-4b89-a827-5e6f64ee1366 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034686 Apr 13 15:19:21 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 195/578] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:19:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:19:50 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=4 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:19:50 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=8 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:19:50 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c1b98959-9c8c-41ed-ae02-4e3de6f90a7b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:19:50 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-c1b98959-9c8c-41ed-ae02-4e3de6f90a7b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c1b98959-9c8c-41ed-ae02-4e3de6f90a7b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c1b98959-9c8c-41ed-ae02-4e3de6f90a7b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c1b98959-9c8c-41ed-ae02-4e3de6f90a7b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c1b98959-9c8c-41ed-ae02-4e3de6f90a7b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c1b98959-9c8c-41ed-ae02-4e3de6f90a7b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:50 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c1b98959-9c8c-41ed-ae02-4e3de6f90a7b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:50 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-c1b98959-9c8c-41ed-ae02-4e3de6f90a7b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e while it is in vm_state rescued Apr 13 15:19:50 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c1b98959-9c8c-41ed-ae02-4e3de6f90a7b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Request method failure captured: Apr 13 15:19:50 user devstack@n-api.service[61871]: request: DELETE /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e/os-volume_attachments/e0953e89-df86-47d7-9d9d-a5e263476027 HTTP/1.1 Apr 13 15:19:50 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:19:50 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:19:50 user devstack@n-api.service[61871]: Connection: close Apr 13 15:19:50 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:19:50 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:19:50 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:19:50 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:19:50 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:19:50 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBqsGdw3aycWoeNTF5dIwz9M4XoihFvfDydEnbooAOgxqZE-k6qSuH5o67HiM2sVa6RcOyUtIsnkDUaPOUoPWZlOnWwrJAmh2HS8sFequPAvZEFaKGsiH5QLqfUXGyfRHGhNYdseVYaXNX3DzwjC8qCRhoxAP0-nP_gTeqRe2MpQXfI Apr 13 15:19:50 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:19:50 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:19:50 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:19:50 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:19:50 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:19:50 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:19:50 user devstack@n-api.service[61871]: X-Project-Id: 9bad96fcfa0d4691af2a7990ba9dbd09 Apr 13 15:19:50 user devstack@n-api.service[61871]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-66620130 Apr 13 15:19:50 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:19:50 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:19:50 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9bad96fcfa0d4691af2a7990ba9dbd09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bad96fcfa0d4691af2a7990ba9dbd09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bad96fcfa0d4691af2a7990ba9dbd09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:19:50 user devstack@n-api.service[61871]: X-Tenant: tempest-ServerRescueNegativeTestJSON-66620130 Apr 13 15:19:50 user devstack@n-api.service[61871]: X-Tenant-Id: 9bad96fcfa0d4691af2a7990ba9dbd09 Apr 13 15:19:50 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-66620130 Apr 13 15:19:50 user devstack@n-api.service[61871]: X-User: tempest-ServerRescueNegativeTestJSON-66620130-project-member Apr 13 15:19:50 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:19:50 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:19:50 user devstack@n-api.service[61871]: X-User-Id: c83940ddaaf64d94b40df9d00349aa91 Apr 13 15:19:50 user devstack@n-api.service[61871]: X-User-Name: tempest-ServerRescueNegativeTestJSON-66620130-project-member Apr 13 15:19:50 user devstack@n-api.service[61871]: method: > Apr 13 15:19:50 user devstack@n-api.service[61871]: exception: Cannot 'detach_volume' instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e while it is in vm_state rescued Apr 13 15:19:50 user devstack@n-api.service[61871]: action_args: {'server_id': '8b883f51-b15c-42d7-b71a-e80c11e7d77e', 'id': 'e0953e89-df86-47d7-9d9d-a5e263476027'} Apr 13 15:19:50 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e while it is in vm_state rescued Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e while it is in vm_state rescued Apr 13 15:19:50 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:19:50 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c1b98959-9c8c-41ed-ae02-4e3de6f90a7b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Returning 409 to user: Cannot 'detach_volume' instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e while it is in vm_state rescued {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:19:50 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-c1b98959-9c8c-41ed-ae02-4e3de6f90a7b tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e/os-volume_attachments/e0953e89-df86-47d7-9d9d-a5e263476027" status: 409 len: 152 microversion: 2.1 time: 0.116966 Apr 13 15:19:50 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 190/579] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:19:50 2023] DELETE /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e/os-volume_attachments/e0953e89-df86-47d7-9d9d-a5e263476027 => generated 152 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 13 15:19:50 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-8bb72cb3-47b2-4b82-8bcf-b8635b380d44 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:19:50 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-8bb72cb3-47b2-4b82-8bcf-b8635b380d44 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:50 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:19:50 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=5 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:19:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8bb72cb3-47b2-4b82-8bcf-b8635b380d44 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8bb72cb3-47b2-4b82-8bcf-b8635b380d44 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8bb72cb3-47b2-4b82-8bcf-b8635b380d44 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8bb72cb3-47b2-4b82-8bcf-b8635b380d44 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8bb72cb3-47b2-4b82-8bcf-b8635b380d44 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8bb72cb3-47b2-4b82-8bcf-b8635b380d44 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:50 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-8bb72cb3-47b2-4b82-8bcf-b8635b380d44 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e/action" status: 202 len: 0 microversion: 2.1 time: 0.076993 Apr 13 15:19:50 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 195/580] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:19:50 2023] POST /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:19:50 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-ba557bff-a44f-4a21-9a8c-7505c0b384bd tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:19:50 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-ba557bff-a44f-4a21-9a8c-7505c0b384bd tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:50 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:19:50 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=14 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:19:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ba557bff-a44f-4a21-9a8c-7505c0b384bd tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ba557bff-a44f-4a21-9a8c-7505c0b384bd tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ba557bff-a44f-4a21-9a8c-7505c0b384bd tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ba557bff-a44f-4a21-9a8c-7505c0b384bd tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ba557bff-a44f-4a21-9a8c-7505c0b384bd tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ba557bff-a44f-4a21-9a8c-7505c0b384bd tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:50 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-ba557bff-a44f-4a21-9a8c-7505c0b384bd tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:19:50 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-ba557bff-a44f-4a21-9a8c-7505c0b384bd tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e" status: 200 len: 1712 microversion: 2.1 time: 0.232561 Apr 13 15:19:50 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 196/581] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:19:50 2023] GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e => generated 1712 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:19:51 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-d57f175e-f967-4c6d-bf14-25d2e558ee6c req-1c3cadb8-1f6d-408b-bd63-82d597a43886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "name": "network-vif-unplugged", "status": "completed", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:19:51 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-d57f175e-f967-4c6d-bf14-25d2e558ee6c req-1c3cadb8-1f6d-408b-bd63-82d597a43886 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:51 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-d57f175e-f967-4c6d-bf14-25d2e558ee6c req-1c3cadb8-1f6d-408b-bd63-82d597a43886 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:51 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-d57f175e-f967-4c6d-bf14-25d2e558ee6c req-1c3cadb8-1f6d-408b-bd63-82d597a43886 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:51 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-d57f175e-f967-4c6d-bf14-25d2e558ee6c req-1c3cadb8-1f6d-408b-bd63-82d597a43886 service nova] Creating event network-vif-unplugged:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:19:51 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-d57f175e-f967-4c6d-bf14-25d2e558ee6c req-1c3cadb8-1f6d-408b-bd63-82d597a43886 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030259 Apr 13 15:19:51 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 191/582] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:19:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:19:52 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-0c3e8e96-03c9-4c0d-880e-56a78b0edabe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:19:52 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-0c3e8e96-03c9-4c0d-880e-56a78b0edabe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0c3e8e96-03c9-4c0d-880e-56a78b0edabe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0c3e8e96-03c9-4c0d-880e-56a78b0edabe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0c3e8e96-03c9-4c0d-880e-56a78b0edabe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0c3e8e96-03c9-4c0d-880e-56a78b0edabe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0c3e8e96-03c9-4c0d-880e-56a78b0edabe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0c3e8e96-03c9-4c0d-880e-56a78b0edabe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:53 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-0c3e8e96-03c9-4c0d-880e-56a78b0edabe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:19:53 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-0c3e8e96-03c9-4c0d-880e-56a78b0edabe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" status: 200 len: 1746 microversion: 2.1 time: 0.277974 Apr 13 15:19:53 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 196/583] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:19:52 2023] GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe => generated 1746 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:19:53 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "name": "network-vif-plugged", "status": "completed", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}, {"server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "name": "network-vif-plugged", "status": "completed", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}, {"server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "name": "network-vif-plugged", "status": "completed", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}, {"server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "name": "network-vif-unplugged", "status": "completed", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}, {"server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "name": "network-vif-plugged", "status": "completed", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}, {"server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "name": "network-vif-plugged", "status": "completed", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:19:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:53 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Creating event network-vif-plugged:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:19:53 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Creating event network-vif-plugged:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:19:53 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Creating event network-vif-plugged:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:19:53 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Creating event network-vif-unplugged:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:19:53 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Creating event network-vif-plugged:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:19:53 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Creating event network-vif-plugged:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:19:53 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.044714 Apr 13 15:19:53 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 197/584] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:19:53 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:19:55 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-1f38f584-a2aa-4819-8edc-ac5fa8a3b4b6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:19:55 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-1f38f584-a2aa-4819-8edc-ac5fa8a3b4b6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1f38f584-a2aa-4819-8edc-ac5fa8a3b4b6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1f38f584-a2aa-4819-8edc-ac5fa8a3b4b6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1f38f584-a2aa-4819-8edc-ac5fa8a3b4b6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1f38f584-a2aa-4819-8edc-ac5fa8a3b4b6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1f38f584-a2aa-4819-8edc-ac5fa8a3b4b6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1f38f584-a2aa-4819-8edc-ac5fa8a3b4b6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:55 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-1f38f584-a2aa-4819-8edc-ac5fa8a3b4b6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:19:55 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-1f38f584-a2aa-4819-8edc-ac5fa8a3b4b6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:19:55 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-1f38f584-a2aa-4819-8edc-ac5fa8a3b4b6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:19:55 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-1f38f584-a2aa-4819-8edc-ac5fa8a3b4b6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f" status: 200 len: 1767 microversion: 2.87 time: 0.169163 Apr 13 15:19:55 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 192/585] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:19:55 2023] GET /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f => generated 1767 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:19:55 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-f0d0e3c2-16a0-4a26-aa51-0c16bc884c0a req-318128f1-c36a-4eb0-aa6e-6ee363d4911c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "name": "network-vif-plugged", "status": "completed", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:19:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f0d0e3c2-16a0-4a26-aa51-0c16bc884c0a req-318128f1-c36a-4eb0-aa6e-6ee363d4911c service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f0d0e3c2-16a0-4a26-aa51-0c16bc884c0a req-318128f1-c36a-4eb0-aa6e-6ee363d4911c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f0d0e3c2-16a0-4a26-aa51-0c16bc884c0a req-318128f1-c36a-4eb0-aa6e-6ee363d4911c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:55 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-f0d0e3c2-16a0-4a26-aa51-0c16bc884c0a req-318128f1-c36a-4eb0-aa6e-6ee363d4911c service nova] Creating event network-vif-plugged:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:19:55 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-f0d0e3c2-16a0-4a26-aa51-0c16bc884c0a req-318128f1-c36a-4eb0-aa6e-6ee363d4911c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028986 Apr 13 15:19:55 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 197/586] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:19:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:19:55 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-eabf5711-74bb-4b56-8524-dc8a076be3f7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:19:55 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-eabf5711-74bb-4b56-8524-dc8a076be3f7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-eabf5711-74bb-4b56-8524-dc8a076be3f7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-eabf5711-74bb-4b56-8524-dc8a076be3f7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-eabf5711-74bb-4b56-8524-dc8a076be3f7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-eabf5711-74bb-4b56-8524-dc8a076be3f7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-eabf5711-74bb-4b56-8524-dc8a076be3f7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-eabf5711-74bb-4b56-8524-dc8a076be3f7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:55 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-eabf5711-74bb-4b56-8524-dc8a076be3f7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.113489 Apr 13 15:19:55 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 198/587] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 15:19:55 2023] GET /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5/os-interface => generated 282 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:19:56 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-0bc681ec-1c28-4ebe-93f3-db99cc407bc8 req-9a5bc886-05ac-46f0-b71e-56c931572289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77237c63-ee05-45ee-b9d7-a79deb5557d5", "tag": "69f51766-5253-402e-8928-e02e0636e8fb"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:19:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-0bc681ec-1c28-4ebe-93f3-db99cc407bc8 req-9a5bc886-05ac-46f0-b71e-56c931572289 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-0bc681ec-1c28-4ebe-93f3-db99cc407bc8 req-9a5bc886-05ac-46f0-b71e-56c931572289 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-0bc681ec-1c28-4ebe-93f3-db99cc407bc8 req-9a5bc886-05ac-46f0-b71e-56c931572289 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:56 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-0bc681ec-1c28-4ebe-93f3-db99cc407bc8 req-9a5bc886-05ac-46f0-b71e-56c931572289 service nova] Creating event network-changed:69f51766-5253-402e-8928-e02e0636e8fb for instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 on user Apr 13 15:19:56 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-0bc681ec-1c28-4ebe-93f3-db99cc407bc8 req-9a5bc886-05ac-46f0-b71e-56c931572289 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032844 Apr 13 15:19:56 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 193/588] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:19:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:19:56 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-47df832a-0702-40a5-9c86-f0abc3e96209 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:19:56 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-47df832a-0702-40a5-9c86-f0abc3e96209 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-47df832a-0702-40a5-9c86-f0abc3e96209 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-47df832a-0702-40a5-9c86-f0abc3e96209 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-47df832a-0702-40a5-9c86-f0abc3e96209 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-47df832a-0702-40a5-9c86-f0abc3e96209 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-47df832a-0702-40a5-9c86-f0abc3e96209 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-47df832a-0702-40a5-9c86-f0abc3e96209 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:56 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-47df832a-0702-40a5-9c86-f0abc3e96209 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5/ips" status: 200 len: 108 microversion: 2.1 time: 0.040310 Apr 13 15:19:56 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 198/589] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 15:19:56 2023] GET /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5/ips => generated 108 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:19:56 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-9933ac3d-12a6-4dca-8e46-88af3baccd84 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73467274-8e1f-4536-9458-f3e619202566"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:19:56 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-9933ac3d-12a6-4dca-8e46-88af3baccd84 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9933ac3d-12a6-4dca-8e46-88af3baccd84 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9933ac3d-12a6-4dca-8e46-88af3baccd84 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9933ac3d-12a6-4dca-8e46-88af3baccd84 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9933ac3d-12a6-4dca-8e46-88af3baccd84 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9933ac3d-12a6-4dca-8e46-88af3baccd84 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9933ac3d-12a6-4dca-8e46-88af3baccd84 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:56 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-9933ac3d-12a6-4dca-8e46-88af3baccd84 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] HTTP exception thrown: Invalid volume: volume 73467274-8e1f-4536-9458-f3e619202566 is already attached to instances: 3dc146f3-9150-4920-b468-9aebcbc81162 Apr 13 15:19:56 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-9933ac3d-12a6-4dca-8e46-88af3baccd84 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Request method failure captured: Apr 13 15:19:56 user devstack@n-api.service[61873]: request: POST /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5/os-volume_attachments HTTP/1.1 Apr 13 15:19:56 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:19:56 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:19:56 user devstack@n-api.service[61873]: Connection: close Apr 13 15:19:56 user devstack@n-api.service[61873]: Content-Length: 74 Apr 13 15:19:56 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:19:56 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:19:56 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:19:56 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:19:56 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBysJSC_pL1o3J9cVhCfPJH0RJxZJE2XjaF2Yq1nITqHQPAUJ-sY0C6ehk0hgyb5AGui4kwa-lWhEaqyW-11oCzt4s9SAjj7iiHUYBf3mDz8zQD6VpCcWxM23IvnmM9hydVYLDDtvrzvCJbTCSuVNPu3nJmaP7WJ6HL0s88zCkG70Us Apr 13 15:19:56 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:19:56 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:19:56 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:19:56 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:19:56 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:19:56 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:19:56 user devstack@n-api.service[61873]: X-Project-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:19:56 user devstack@n-api.service[61873]: X-Project-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:19:56 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:19:56 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:19:56 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:19:56 user devstack@n-api.service[61873]: X-Tenant: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:19:56 user devstack@n-api.service[61873]: X-Tenant-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:19:56 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:19:56 user devstack@n-api.service[61873]: X-User: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:19:56 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:19:56 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:19:56 user devstack@n-api.service[61873]: X-User-Id: fedd34ccc15c47f9a4fc96b080730acd Apr 13 15:19:56 user devstack@n-api.service[61873]: X-User-Name: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:19:56 user devstack@n-api.service[61873]: Apr 13 15:19:56 user devstack@n-api.service[61873]: {"volumeAttachment": {"volumeId": "73467274-8e1f-4536-9458-f3e619202566"}} Apr 13 15:19:56 user devstack@n-api.service[61873]: method: > Apr 13 15:19:56 user devstack@n-api.service[61873]: exception: Invalid volume: volume 73467274-8e1f-4536-9458-f3e619202566 is already attached to instances: 3dc146f3-9150-4920-b468-9aebcbc81162 Apr 13 15:19:56 user devstack@n-api.service[61873]: action_args: {'server_id': '77237c63-ee05-45ee-b9d7-a79deb5557d5', 'body': {'volumeAttachment': {'volumeId': '73467274-8e1f-4536-9458-f3e619202566'}}} Apr 13 15:19:56 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 73467274-8e1f-4536-9458-f3e619202566 is already attached to instances: 3dc146f3-9150-4920-b468-9aebcbc81162 Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 73467274-8e1f-4536-9458-f3e619202566 is already attached to instances: 3dc146f3-9150-4920-b468-9aebcbc81162 Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 73467274-8e1f-4536-9458-f3e619202566 is already attached to instances: 3dc146f3-9150-4920-b468-9aebcbc81162 Apr 13 15:19:56 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:19:56 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-9933ac3d-12a6-4dca-8e46-88af3baccd84 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Returning 400 to user: Invalid volume: volume 73467274-8e1f-4536-9458-f3e619202566 is already attached to instances: 3dc146f3-9150-4920-b468-9aebcbc81162 {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:19:56 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-9933ac3d-12a6-4dca-8e46-88af3baccd84 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "POST /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099179 Apr 13 15:19:56 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 199/590] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:19:56 2023] POST /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:19:56 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:19:56 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:56 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Going to try to terminate instance {{(pid=61871) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:19:56 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5" status: 204 len: 0 microversion: 2.1 time: 0.131866 Apr 13 15:19:56 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 194/591] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:19:56 2023] DELETE /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:19:56 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-44352eb1-9637-4aeb-ad18-cf76bd4fd99e tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:19:56 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-44352eb1-9637-4aeb-ad18-cf76bd4fd99e tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:19:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-44352eb1-9637-4aeb-ad18-cf76bd4fd99e tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-44352eb1-9637-4aeb-ad18-cf76bd4fd99e tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-44352eb1-9637-4aeb-ad18-cf76bd4fd99e tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-44352eb1-9637-4aeb-ad18-cf76bd4fd99e tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-44352eb1-9637-4aeb-ad18-cf76bd4fd99e tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-44352eb1-9637-4aeb-ad18-cf76bd4fd99e tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:56 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-44352eb1-9637-4aeb-ad18-cf76bd4fd99e tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedd34ccc15c47f9a4fc96b080730acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3ba2d132c445039d0ae30ffd2bc64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:19:56 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-8e1f3a05-f62f-4b62-a44f-b99250dcfdcc req-ac9436d0-ae2d-4a58-9c4f-cbeee708a4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77237c63-ee05-45ee-b9d7-a79deb5557d5", "name": "network-vif-unplugged", "status": "completed", "tag": "69f51766-5253-402e-8928-e02e0636e8fb"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:19:56 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-44352eb1-9637-4aeb-ad18-cf76bd4fd99e tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5" status: 200 len: 1550 microversion: 2.1 time: 0.329917 Apr 13 15:19:56 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 199/592] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:19:56 2023] GET /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5 => generated 1550 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:19:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-8e1f3a05-f62f-4b62-a44f-b99250dcfdcc req-ac9436d0-ae2d-4a58-9c4f-cbeee708a4cf service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-8e1f3a05-f62f-4b62-a44f-b99250dcfdcc req-ac9436d0-ae2d-4a58-9c4f-cbeee708a4cf service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-8e1f3a05-f62f-4b62-a44f-b99250dcfdcc req-ac9436d0-ae2d-4a58-9c4f-cbeee708a4cf service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:56 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-8e1f3a05-f62f-4b62-a44f-b99250dcfdcc req-ac9436d0-ae2d-4a58-9c4f-cbeee708a4cf service nova] Creating event network-vif-unplugged:69f51766-5253-402e-8928-e02e0636e8fb for instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 on user Apr 13 15:19:56 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-8e1f3a05-f62f-4b62-a44f-b99250dcfdcc req-ac9436d0-ae2d-4a58-9c4f-cbeee708a4cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029797 Apr 13 15:19:56 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 200/593] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:19:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:19:58 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-eaa5606c-2ea5-4166-9522-7248b0628bbf req-3dd2c1c7-1dc6-4130-9294-3a10771318b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77237c63-ee05-45ee-b9d7-a79deb5557d5", "name": "network-vif-deleted", "tag": "69f51766-5253-402e-8928-e02e0636e8fb"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:19:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-eaa5606c-2ea5-4166-9522-7248b0628bbf req-3dd2c1c7-1dc6-4130-9294-3a10771318b5 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-eaa5606c-2ea5-4166-9522-7248b0628bbf req-3dd2c1c7-1dc6-4130-9294-3a10771318b5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-eaa5606c-2ea5-4166-9522-7248b0628bbf req-3dd2c1c7-1dc6-4130-9294-3a10771318b5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:58 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-eaa5606c-2ea5-4166-9522-7248b0628bbf req-3dd2c1c7-1dc6-4130-9294-3a10771318b5 service nova] Creating event network-vif-deleted:69f51766-5253-402e-8928-e02e0636e8fb for instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 on user Apr 13 15:19:58 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-eaa5606c-2ea5-4166-9522-7248b0628bbf req-3dd2c1c7-1dc6-4130-9294-3a10771318b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038409 Apr 13 15:19:58 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 195/594] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:19:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:19:58 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-6a3b6985-a618-4b69-8862-2ff7c2ed081c req-5a246656-d973-45dc-baf8-94e63d730eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77237c63-ee05-45ee-b9d7-a79deb5557d5", "name": "network-vif-plugged", "status": "completed", "tag": "69f51766-5253-402e-8928-e02e0636e8fb"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:19:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-6a3b6985-a618-4b69-8862-2ff7c2ed081c req-5a246656-d973-45dc-baf8-94e63d730eb3 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:19:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-6a3b6985-a618-4b69-8862-2ff7c2ed081c req-5a246656-d973-45dc-baf8-94e63d730eb3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:19:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-6a3b6985-a618-4b69-8862-2ff7c2ed081c req-5a246656-d973-45dc-baf8-94e63d730eb3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:19:59 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-6a3b6985-a618-4b69-8862-2ff7c2ed081c req-5a246656-d973-45dc-baf8-94e63d730eb3 service nova] Creating event network-vif-plugged:69f51766-5253-402e-8928-e02e0636e8fb for instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 on user Apr 13 15:19:59 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-6a3b6985-a618-4b69-8862-2ff7c2ed081c req-5a246656-d973-45dc-baf8-94e63d730eb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029028 Apr 13 15:19:59 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 200/595] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:19:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=10 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=20 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-d523c97c-153f-443a-8a91-3dc321b3982c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-d523c97c-153f-443a-8a91-3dc321b3982c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d523c97c-153f-443a-8a91-3dc321b3982c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d523c97c-153f-443a-8a91-3dc321b3982c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d523c97c-153f-443a-8a91-3dc321b3982c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d523c97c-153f-443a-8a91-3dc321b3982c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d523c97c-153f-443a-8a91-3dc321b3982c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d523c97c-153f-443a-8a91-3dc321b3982c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-d523c97c-153f-443a-8a91-3dc321b3982c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:20:20 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-d523c97c-153f-443a-8a91-3dc321b3982c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1676 microversion: 2.1 time: 0.171893 Apr 13 15:20:20 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 201/596] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:20:20 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:20:20 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:20:20 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:20:20 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23e2b917-2efe-4a44-8c06-1a70d0c6d09f"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:20:20 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:20:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:20 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:20:20 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=12 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:20:20 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:20:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:20 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Going to try to start instance {{(pid=61872) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 13 15:20:20 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3/action" status: 202 len: 0 microversion: 2.1 time: 0.071762 Apr 13 15:20:20 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 201/597] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:20:20 2023] POST /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3/action => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-d75f10f0-2085-45e3-87f5-9919b3bb63b9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-d75f10f0-2085-45e3-87f5-9919b3bb63b9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d75f10f0-2085-45e3-87f5-9919b3bb63b9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d75f10f0-2085-45e3-87f5-9919b3bb63b9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d75f10f0-2085-45e3-87f5-9919b3bb63b9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d75f10f0-2085-45e3-87f5-9919b3bb63b9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d75f10f0-2085-45e3-87f5-9919b3bb63b9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d75f10f0-2085-45e3-87f5-9919b3bb63b9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:20 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275231 Apr 13 15:20:20 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 196/598] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:20:20 2023] POST /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:20:20 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-d75f10f0-2085-45e3-87f5-9919b3bb63b9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1a698b103a47c0b2864eef54be648b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceba33821a9b4f7aa81c2857c11261f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:20:20 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-d75f10f0-2085-45e3-87f5-9919b3bb63b9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3" status: 200 len: 1650 microversion: 2.1 time: 0.173177 Apr 13 15:20:20 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 202/599] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:20:20 2023] GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3 => generated 1650 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:20:23 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-d2ab7b21-9bfd-4eee-bd7c-a79344831efc req-16251906-09b6-4b53-ad85-728c5f09fdf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa74d14-db6f-41f5-b8af-32da312209d3", "name": "network-vif-plugged", "status": "completed", "tag": "84611f06-d6ca-49e1-afe7-7723921e62dc"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:20:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-d2ab7b21-9bfd-4eee-bd7c-a79344831efc req-16251906-09b6-4b53-ad85-728c5f09fdf9 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-d2ab7b21-9bfd-4eee-bd7c-a79344831efc req-16251906-09b6-4b53-ad85-728c5f09fdf9 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-d2ab7b21-9bfd-4eee-bd7c-a79344831efc req-16251906-09b6-4b53-ad85-728c5f09fdf9 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:23 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-d2ab7b21-9bfd-4eee-bd7c-a79344831efc req-16251906-09b6-4b53-ad85-728c5f09fdf9 service nova] Creating event network-vif-plugged:84611f06-d6ca-49e1-afe7-7723921e62dc for instance 1aa74d14-db6f-41f5-b8af-32da312209d3 on user Apr 13 15:20:23 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-d2ab7b21-9bfd-4eee-bd7c-a79344831efc req-16251906-09b6-4b53-ad85-728c5f09fdf9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053129 Apr 13 15:20:23 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 202/600] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:20:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:20:25 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-c92f8dc3-3681-48d1-b217-6b087e9f6675 req-af694eae-0448-4a44-9972-d70fac5ed976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa74d14-db6f-41f5-b8af-32da312209d3", "name": "network-vif-plugged", "status": "completed", "tag": "84611f06-d6ca-49e1-afe7-7723921e62dc"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:20:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c92f8dc3-3681-48d1-b217-6b087e9f6675 req-af694eae-0448-4a44-9972-d70fac5ed976 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c92f8dc3-3681-48d1-b217-6b087e9f6675 req-af694eae-0448-4a44-9972-d70fac5ed976 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c92f8dc3-3681-48d1-b217-6b087e9f6675 req-af694eae-0448-4a44-9972-d70fac5ed976 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:25 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-c92f8dc3-3681-48d1-b217-6b087e9f6675 req-af694eae-0448-4a44-9972-d70fac5ed976 service nova] Creating event network-vif-plugged:84611f06-d6ca-49e1-afe7-7723921e62dc for instance 1aa74d14-db6f-41f5-b8af-32da312209d3 on user Apr 13 15:20:25 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-c92f8dc3-3681-48d1-b217-6b087e9f6675 req-af694eae-0448-4a44-9972-d70fac5ed976 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044101 Apr 13 15:20:25 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 197/601] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:20:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Old instance type m1.nano, new instance type m1.micro {{(pid=61873) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting quotas for project 9154e4239a1a42a3820c27563ba0513f. Resources: {'cores', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting quotas for user 3c12c62d4137473596571e523163e718 and project 9154e4239a1a42a3820c27563ba0513f. Resources: {'cores', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:20:28 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:20:28 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/action" status: 202 len: 0 microversion: 2.1 time: 0.430638 Apr 13 15:20:28 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 203/602] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:20:28 2023] POST /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:20:28 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-8ee2d846-9bc0-4ae9-9288-14d836296654 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:20:28 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-8ee2d846-9bc0-4ae9-9288-14d836296654 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:20:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8ee2d846-9bc0-4ae9-9288-14d836296654 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8ee2d846-9bc0-4ae9-9288-14d836296654 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8ee2d846-9bc0-4ae9-9288-14d836296654 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8ee2d846-9bc0-4ae9-9288-14d836296654 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8ee2d846-9bc0-4ae9-9288-14d836296654 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8ee2d846-9bc0-4ae9-9288-14d836296654 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:29 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-8ee2d846-9bc0-4ae9-9288-14d836296654 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:20:29 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-8ee2d846-9bc0-4ae9-9288-14d836296654 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1731 microversion: 2.1 time: 0.627115 Apr 13 15:20:29 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 203/603] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:20:28 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1731 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:20:32 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-75cdaaa7-6210-456b-bf9d-8c0209134170 req-98feb163-a354-4bcf-b5b6-4083feb83c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b5bd-5f78-448e-bd82-74b2263dff75", "name": "network-vif-unplugged", "status": "completed", "tag": "9c8ad360-aa62-4ef1-952f-d73f885baa89"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:20:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-75cdaaa7-6210-456b-bf9d-8c0209134170 req-98feb163-a354-4bcf-b5b6-4083feb83c7b service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-75cdaaa7-6210-456b-bf9d-8c0209134170 req-98feb163-a354-4bcf-b5b6-4083feb83c7b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-75cdaaa7-6210-456b-bf9d-8c0209134170 req-98feb163-a354-4bcf-b5b6-4083feb83c7b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:32 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-75cdaaa7-6210-456b-bf9d-8c0209134170 req-98feb163-a354-4bcf-b5b6-4083feb83c7b service nova] Creating event network-vif-unplugged:9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 on user Apr 13 15:20:32 user devstack@n-api.service[61871]: DEBUG nova.compute.api [req-75cdaaa7-6210-456b-bf9d-8c0209134170 req-98feb163-a354-4bcf-b5b6-4083feb83c7b service nova] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 15:20:32 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-75cdaaa7-6210-456b-bf9d-8c0209134170 req-98feb163-a354-4bcf-b5b6-4083feb83c7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059963 Apr 13 15:20:32 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 198/604] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:20:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:20:34 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-dd2e8501-0edc-452d-bd99-b7dac881ca42 req-025f27ef-7e0f-4d9f-82b2-0f83acbff850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b5bd-5f78-448e-bd82-74b2263dff75", "name": "network-vif-plugged", "status": "completed", "tag": "9c8ad360-aa62-4ef1-952f-d73f885baa89"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:20:34 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-dd2e8501-0edc-452d-bd99-b7dac881ca42 req-025f27ef-7e0f-4d9f-82b2-0f83acbff850 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:34 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-dd2e8501-0edc-452d-bd99-b7dac881ca42 req-025f27ef-7e0f-4d9f-82b2-0f83acbff850 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:34 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-dd2e8501-0edc-452d-bd99-b7dac881ca42 req-025f27ef-7e0f-4d9f-82b2-0f83acbff850 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:34 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-dd2e8501-0edc-452d-bd99-b7dac881ca42 req-025f27ef-7e0f-4d9f-82b2-0f83acbff850 service nova] Creating event network-vif-plugged:9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 on user Apr 13 15:20:34 user devstack@n-api.service[61873]: DEBUG nova.compute.api [req-dd2e8501-0edc-452d-bd99-b7dac881ca42 req-025f27ef-7e0f-4d9f-82b2-0f83acbff850 service nova] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61873) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 15:20:34 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-dd2e8501-0edc-452d-bd99-b7dac881ca42 req-025f27ef-7e0f-4d9f-82b2-0f83acbff850 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076552 Apr 13 15:20:34 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 204/605] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:20:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:20:40 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-f69a5ed7-713d-426a-b8c3-916f2db8d4cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:20:40 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-f69a5ed7-713d-426a-b8c3-916f2db8d4cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:20:40 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:20:40 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:20:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f69a5ed7-713d-426a-b8c3-916f2db8d4cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f69a5ed7-713d-426a-b8c3-916f2db8d4cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f69a5ed7-713d-426a-b8c3-916f2db8d4cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f69a5ed7-713d-426a-b8c3-916f2db8d4cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f69a5ed7-713d-426a-b8c3-916f2db8d4cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f69a5ed7-713d-426a-b8c3-916f2db8d4cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:40 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-f69a5ed7-713d-426a-b8c3-916f2db8d4cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:20:40 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-f69a5ed7-713d-426a-b8c3-916f2db8d4cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e" status: 200 len: 1718 microversion: 2.1 time: 0.148470 Apr 13 15:20:40 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 204/606] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:20:40 2023] GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:20:44 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-7ad635b8-8413-47f5-b1a7-b7e85a42ff4f req-60755a52-3d38-4078-ba6e-b0e34af96b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b5bd-5f78-448e-bd82-74b2263dff75", "name": "network-vif-plugged", "status": "completed", "tag": "9c8ad360-aa62-4ef1-952f-d73f885baa89"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:20:44 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:20:44 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:20:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-7ad635b8-8413-47f5-b1a7-b7e85a42ff4f req-60755a52-3d38-4078-ba6e-b0e34af96b71 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-7ad635b8-8413-47f5-b1a7-b7e85a42ff4f req-60755a52-3d38-4078-ba6e-b0e34af96b71 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-7ad635b8-8413-47f5-b1a7-b7e85a42ff4f req-60755a52-3d38-4078-ba6e-b0e34af96b71 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:44 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-7ad635b8-8413-47f5-b1a7-b7e85a42ff4f req-60755a52-3d38-4078-ba6e-b0e34af96b71 service nova] Creating event network-vif-plugged:9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 on user Apr 13 15:20:44 user devstack@n-api.service[61871]: DEBUG nova.compute.api [req-7ad635b8-8413-47f5-b1a7-b7e85a42ff4f req-60755a52-3d38-4078-ba6e-b0e34af96b71 service nova] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 15:20:44 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-7ad635b8-8413-47f5-b1a7-b7e85a42ff4f req-60755a52-3d38-4078-ba6e-b0e34af96b71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051967 Apr 13 15:20:44 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 199/607] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:20:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:20:46 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=3 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:20:46 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=20 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:20:46 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:20:46 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-fadb6336-5c9a-45c9-b296-c42a58242064 req-6efb8033-9584-4cd0-817c-15cf8183deb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b5bd-5f78-448e-bd82-74b2263dff75", "name": "network-vif-plugged", "status": "completed", "tag": "9c8ad360-aa62-4ef1-952f-d73f885baa89"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:20:46 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-fadb6336-5c9a-45c9-b296-c42a58242064 req-6efb8033-9584-4cd0-817c-15cf8183deb9 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:46 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-fadb6336-5c9a-45c9-b296-c42a58242064 req-6efb8033-9584-4cd0-817c-15cf8183deb9 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:46 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-fadb6336-5c9a-45c9-b296-c42a58242064 req-6efb8033-9584-4cd0-817c-15cf8183deb9 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:46 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-fadb6336-5c9a-45c9-b296-c42a58242064 req-6efb8033-9584-4cd0-817c-15cf8183deb9 service nova] Creating event network-vif-plugged:9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 on user Apr 13 15:20:46 user devstack@n-api.service[61873]: DEBUG nova.compute.api [req-fadb6336-5c9a-45c9-b296-c42a58242064 req-6efb8033-9584-4cd0-817c-15cf8183deb9 service nova] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61873) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 15:20:46 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-fadb6336-5c9a-45c9-b296-c42a58242064 req-6efb8033-9584-4cd0-817c-15cf8183deb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049384 Apr 13 15:20:46 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 205/608] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:20:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:20:46 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-ff96fc6e-6c92-4dda-8a66-ca8bf8762c97 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:20:46 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-ff96fc6e-6c92-4dda-8a66-ca8bf8762c97 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:20:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ff96fc6e-6c92-4dda-8a66-ca8bf8762c97 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ff96fc6e-6c92-4dda-8a66-ca8bf8762c97 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ff96fc6e-6c92-4dda-8a66-ca8bf8762c97 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ff96fc6e-6c92-4dda-8a66-ca8bf8762c97 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ff96fc6e-6c92-4dda-8a66-ca8bf8762c97 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ff96fc6e-6c92-4dda-8a66-ca8bf8762c97 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:47 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-ff96fc6e-6c92-4dda-8a66-ca8bf8762c97 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] HTTP exception thrown: Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 could not be found. Apr 13 15:20:47 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-ff96fc6e-6c92-4dda-8a66-ca8bf8762c97 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Request method failure captured: Apr 13 15:20:47 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5 HTTP/1.1 Apr 13 15:20:47 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:20:47 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:20:47 user devstack@n-api.service[61872]: Connection: close Apr 13 15:20:47 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:20:47 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:20:47 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:20:47 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:20:47 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:20:47 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBysJSC_pL1o3J9cVhCfPJH0RJxZJE2XjaF2Yq1nITqHQPAUJ-sY0C6ehk0hgyb5AGui4kwa-lWhEaqyW-11oCzt4s9SAjj7iiHUYBf3mDz8zQD6VpCcWxM23IvnmM9hydVYLDDtvrzvCJbTCSuVNPu3nJmaP7WJ6HL0s88zCkG70Us Apr 13 15:20:47 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:20:47 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:20:47 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:20:47 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:20:47 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:20:47 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:20:47 user devstack@n-api.service[61872]: X-Project-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:20:47 user devstack@n-api.service[61872]: X-Project-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:20:47 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:20:47 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:20:47 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:20:47 user devstack@n-api.service[61872]: X-Tenant: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:20:47 user devstack@n-api.service[61872]: X-Tenant-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:20:47 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:20:47 user devstack@n-api.service[61872]: X-User: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:20:47 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:20:47 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:20:47 user devstack@n-api.service[61872]: X-User-Id: fedd34ccc15c47f9a4fc96b080730acd Apr 13 15:20:47 user devstack@n-api.service[61872]: X-User-Name: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:20:47 user devstack@n-api.service[61872]: method: > Apr 13 15:20:47 user devstack@n-api.service[61872]: exception: Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 could not be found. Apr 13 15:20:47 user devstack@n-api.service[61872]: action_args: {'id': '77237c63-ee05-45ee-b9d7-a79deb5557d5'} Apr 13 15:20:47 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 could not be found. Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 could not be found. Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 could not be found. Apr 13 15:20:47 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:20:47 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-ff96fc6e-6c92-4dda-8a66-ca8bf8762c97 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Returning 404 to user: Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:20:47 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-ff96fc6e-6c92-4dda-8a66-ca8bf8762c97 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5" status: 404 len: 111 microversion: 2.1 time: 0.031162 Apr 13 15:20:47 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 205/609] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:20:46 2023] GET /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:20:47 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-55ccb3dd-dfdd-4b01-bb33-be9c51231781 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '.version_select at 0x7f3a8f82da20>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:20:47 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-55ccb3dd-dfdd-4b01-bb33-be9c51231781 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1037646861" status: 202 len: 0 microversion: 2.1 time: 0.023499 Apr 13 15:20:47 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 200/610] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 15:20:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1037646861 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:20:47 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:20:47 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:20:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:47 user devstack@n-api.service[61873]: DEBUG nova.objects.instance [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'services' on Instance uuid 3dc146f3-9150-4920-b468-9aebcbc81162 {{(pid=61873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:20:47 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162/os-volume_attachments/73467274-8e1f-4536-9458-f3e619202566" status: 202 len: 0 microversion: 2.1 time: 0.178057 Apr 13 15:20:47 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 206/611] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:20:47 2023] DELETE /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162/os-volume_attachments/73467274-8e1f-4536-9458-f3e619202566 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:20:48 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-c796ac42-9d43-4aa4-afc3-49f46260e1b2 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:20:48 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-c796ac42-9d43-4aa4-afc3-49f46260e1b2 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:20:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c796ac42-9d43-4aa4-afc3-49f46260e1b2 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c796ac42-9d43-4aa4-afc3-49f46260e1b2 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c796ac42-9d43-4aa4-afc3-49f46260e1b2 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c796ac42-9d43-4aa4-afc3-49f46260e1b2 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c796ac42-9d43-4aa4-afc3-49f46260e1b2 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c796ac42-9d43-4aa4-afc3-49f46260e1b2 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:48 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-c796ac42-9d43-4aa4-afc3-49f46260e1b2 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051028 Apr 13 15:20:48 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 206/612] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:20:48 2023] GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:20:53 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-b4c80a5b-e9dd-419c-b6b7-022ef1c39b9d tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-809205949"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:20:53 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-b4c80a5b-e9dd-419c-b6b7-022ef1c39b9d tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:20:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b4c80a5b-e9dd-419c-b6b7-022ef1c39b9d tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b4c80a5b-e9dd-419c-b6b7-022ef1c39b9d tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b4c80a5b-e9dd-419c-b6b7-022ef1c39b9d tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b4c80a5b-e9dd-419c-b6b7-022ef1c39b9d tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b4c80a5b-e9dd-419c-b6b7-022ef1c39b9d tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b4c80a5b-e9dd-419c-b6b7-022ef1c39b9d tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:53 user devstack@n-api.service[61871]: INFO nova.network.security_group_api [None req-b4c80a5b-e9dd-419c-b6b7-022ef1c39b9d tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Removing security group ef644a5d-06dc-43f6-9f9c-0f3e22b2f58b from port df99421e-bdc6-4fe5-9865-823bcb128ccc Apr 13 15:20:53 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-b4c80a5b-e9dd-419c-b6b7-022ef1c39b9d tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/action" status: 202 len: 0 microversion: 2.1 time: 0.583682 Apr 13 15:20:53 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 201/613] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:20:53 2023] POST /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:20:53 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-994cc429-4bde-4cd5-8d6d-b2251d4a4a78 req-04b038d8-445d-4200-9a97-281d3531b7ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe", "tag": "df99421e-bdc6-4fe5-9865-823bcb128ccc"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:20:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-994cc429-4bde-4cd5-8d6d-b2251d4a4a78 req-04b038d8-445d-4200-9a97-281d3531b7ad service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-994cc429-4bde-4cd5-8d6d-b2251d4a4a78 req-04b038d8-445d-4200-9a97-281d3531b7ad service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-994cc429-4bde-4cd5-8d6d-b2251d4a4a78 req-04b038d8-445d-4200-9a97-281d3531b7ad service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:53 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-994cc429-4bde-4cd5-8d6d-b2251d4a4a78 req-04b038d8-445d-4200-9a97-281d3531b7ad service nova] Creating event network-changed:df99421e-bdc6-4fe5-9865-823bcb128ccc for instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe on user Apr 13 15:20:53 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-994cc429-4bde-4cd5-8d6d-b2251d4a4a78 req-04b038d8-445d-4200-9a97-281d3531b7ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037283 Apr 13 15:20:53 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 207/614] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:20:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:20:54 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:20:54 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:20:54 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-9b423931-0522-42ef-b101-5ef88e04a9eb req-cbba8210-d89a-43d3-82c6-b3f9731234f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe", "tag": "df99421e-bdc6-4fe5-9865-823bcb128ccc"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:20:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-9b423931-0522-42ef-b101-5ef88e04a9eb req-cbba8210-d89a-43d3-82c6-b3f9731234f3 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-9b423931-0522-42ef-b101-5ef88e04a9eb req-cbba8210-d89a-43d3-82c6-b3f9731234f3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-9b423931-0522-42ef-b101-5ef88e04a9eb req-cbba8210-d89a-43d3-82c6-b3f9731234f3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:54 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-9b423931-0522-42ef-b101-5ef88e04a9eb req-cbba8210-d89a-43d3-82c6-b3f9731234f3 service nova] Creating event network-changed:df99421e-bdc6-4fe5-9865-823bcb128ccc for instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe on user Apr 13 15:20:54 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-9b423931-0522-42ef-b101-5ef88e04a9eb req-cbba8210-d89a-43d3-82c6-b3f9731234f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028132 Apr 13 15:20:54 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 202/615] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:20:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:20:55 user devstack@n-api.service[61872]: DEBUG nova.objects.instance [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lazy-loading 'services' on Instance uuid e1c4cb29-65fa-4b48-b7a2-cac613cb96fe {{(pid=61872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:20:55 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/os-volume_attachments/11a7881b-efa3-43da-9fd0-3e26df187b17" status: 202 len: 0 microversion: 2.1 time: 0.208934 Apr 13 15:20:55 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 207/616] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:20:54 2023] DELETE /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/os-volume_attachments/11a7881b-efa3-43da-9fd0-3e26df187b17 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:20:55 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f2335533-c287-48c8-861c-68e53fd07323 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:20:55 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-f2335533-c287-48c8-861c-68e53fd07323 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:20:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f2335533-c287-48c8-861c-68e53fd07323 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f2335533-c287-48c8-861c-68e53fd07323 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f2335533-c287-48c8-861c-68e53fd07323 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f2335533-c287-48c8-861c-68e53fd07323 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f2335533-c287-48c8-861c-68e53fd07323 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f2335533-c287-48c8-861c-68e53fd07323 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:55 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-f2335533-c287-48c8-861c-68e53fd07323 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043997 Apr 13 15:20:55 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 208/617] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:20:55 2023] GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:20:55 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "1b8e7776-9945-4e57-b8ce-e785793cb330"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:20:55 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:20:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:55 user devstack@n-api.service[61871]: DEBUG nova.objects.instance [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'flavor' on Instance uuid c609c1d1-edcf-4b71-abea-5dd95ebcd81f {{(pid=61871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:20:56 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/action" status: 200 len: 29 microversion: 2.87 time: 0.627816 Apr 13 15:20:56 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 203/618] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 15:20:55 2023] POST /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/action => generated 29 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:20:56 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-7ca0fa14-0564-42c2-897a-98fb69110bdf tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:20:56 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-7ca0fa14-0564-42c2-897a-98fb69110bdf tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:20:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7ca0fa14-0564-42c2-897a-98fb69110bdf tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7ca0fa14-0564-42c2-897a-98fb69110bdf tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7ca0fa14-0564-42c2-897a-98fb69110bdf tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7ca0fa14-0564-42c2-897a-98fb69110bdf tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7ca0fa14-0564-42c2-897a-98fb69110bdf tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7ca0fa14-0564-42c2-897a-98fb69110bdf tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:56 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-7ca0fa14-0564-42c2-897a-98fb69110bdf tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:20:56 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-7ca0fa14-0564-42c2-897a-98fb69110bdf tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:20:56 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-7ca0fa14-0564-42c2-897a-98fb69110bdf tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:20:56 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-7ca0fa14-0564-42c2-897a-98fb69110bdf tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f" status: 200 len: 1773 microversion: 2.87 time: 0.240188 Apr 13 15:20:56 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 208/619] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:20:56 2023] GET /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f => generated 1773 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:20:57 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-e735f07f-d68c-4030-be95-91ee4884c73f req-913f2ab1-de50-4efa-a3d0-0f39a1059248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c609c1d1-edcf-4b71-abea-5dd95ebcd81f", "name": "network-vif-unplugged", "status": "completed", "tag": "92d492eb-f3b6-4481-b492-949cf7eabd1a"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:20:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-e735f07f-d68c-4030-be95-91ee4884c73f req-913f2ab1-de50-4efa-a3d0-0f39a1059248 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-e735f07f-d68c-4030-be95-91ee4884c73f req-913f2ab1-de50-4efa-a3d0-0f39a1059248 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-e735f07f-d68c-4030-be95-91ee4884c73f req-913f2ab1-de50-4efa-a3d0-0f39a1059248 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:57 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-e735f07f-d68c-4030-be95-91ee4884c73f req-913f2ab1-de50-4efa-a3d0-0f39a1059248 service nova] Creating event network-vif-unplugged:92d492eb-f3b6-4481-b492-949cf7eabd1a for instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f on user Apr 13 15:20:57 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-e735f07f-d68c-4030-be95-91ee4884c73f req-913f2ab1-de50-4efa-a3d0-0f39a1059248 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032015 Apr 13 15:20:57 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 209/620] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:20:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:20:59 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-60d33d88-9f9a-4ac9-9773-f18a73f4095c req-f5a2403b-58a7-4cd2-84c1-b93cb83cc366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c609c1d1-edcf-4b71-abea-5dd95ebcd81f", "name": "network-vif-plugged", "status": "completed", "tag": "92d492eb-f3b6-4481-b492-949cf7eabd1a"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:20:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-60d33d88-9f9a-4ac9-9773-f18a73f4095c req-f5a2403b-58a7-4cd2-84c1-b93cb83cc366 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:20:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-60d33d88-9f9a-4ac9-9773-f18a73f4095c req-f5a2403b-58a7-4cd2-84c1-b93cb83cc366 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:20:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-60d33d88-9f9a-4ac9-9773-f18a73f4095c req-f5a2403b-58a7-4cd2-84c1-b93cb83cc366 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:20:59 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-60d33d88-9f9a-4ac9-9773-f18a73f4095c req-f5a2403b-58a7-4cd2-84c1-b93cb83cc366 service nova] Creating event network-vif-plugged:92d492eb-f3b6-4481-b492-949cf7eabd1a for instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f on user Apr 13 15:20:59 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-60d33d88-9f9a-4ac9-9773-f18a73f4095c req-f5a2403b-58a7-4cd2-84c1-b93cb83cc366 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044255 Apr 13 15:20:59 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 204/621] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:20:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:21:01 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-399bdd3c-78e3-4ef6-8998-a5f340841832 req-72d3ed80-82e6-4277-a928-126eb5252275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c609c1d1-edcf-4b71-abea-5dd95ebcd81f", "name": "network-vif-plugged", "status": "completed", "tag": "92d492eb-f3b6-4481-b492-949cf7eabd1a"}, {"server_uuid": "c609c1d1-edcf-4b71-abea-5dd95ebcd81f", "name": "network-vif-plugged", "status": "completed", "tag": "92d492eb-f3b6-4481-b492-949cf7eabd1a"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:21:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-399bdd3c-78e3-4ef6-8998-a5f340841832 req-72d3ed80-82e6-4277-a928-126eb5252275 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-399bdd3c-78e3-4ef6-8998-a5f340841832 req-72d3ed80-82e6-4277-a928-126eb5252275 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-399bdd3c-78e3-4ef6-8998-a5f340841832 req-72d3ed80-82e6-4277-a928-126eb5252275 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:01 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-399bdd3c-78e3-4ef6-8998-a5f340841832 req-72d3ed80-82e6-4277-a928-126eb5252275 service nova] Creating event network-vif-plugged:92d492eb-f3b6-4481-b492-949cf7eabd1a for instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f on user Apr 13 15:21:01 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-399bdd3c-78e3-4ef6-8998-a5f340841832 req-72d3ed80-82e6-4277-a928-126eb5252275 service nova] Creating event network-vif-plugged:92d492eb-f3b6-4481-b492-949cf7eabd1a for instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f on user Apr 13 15:21:01 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-399bdd3c-78e3-4ef6-8998-a5f340841832 req-72d3ed80-82e6-4277-a928-126eb5252275 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031611 Apr 13 15:21:01 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 209/622] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:21:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:21:10 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=10 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:21:10 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:21:10 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-4482ff2c-7185-4bf1-b0b6-0c29cc5857f9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:21:10 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-4482ff2c-7185-4bf1-b0b6-0c29cc5857f9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:21:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4482ff2c-7185-4bf1-b0b6-0c29cc5857f9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4482ff2c-7185-4bf1-b0b6-0c29cc5857f9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4482ff2c-7185-4bf1-b0b6-0c29cc5857f9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4482ff2c-7185-4bf1-b0b6-0c29cc5857f9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4482ff2c-7185-4bf1-b0b6-0c29cc5857f9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4482ff2c-7185-4bf1-b0b6-0c29cc5857f9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:10 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-4482ff2c-7185-4bf1-b0b6-0c29cc5857f9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1a698b103a47c0b2864eef54be648b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceba33821a9b4f7aa81c2857c11261f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:21:10 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-4482ff2c-7185-4bf1-b0b6-0c29cc5857f9 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3" status: 200 len: 1654 microversion: 2.1 time: 0.155663 Apr 13 15:21:10 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 210/623] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:21:10 2023] GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3 => generated 1654 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:21:19 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:21:19 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:21:19 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-96015279-ab69-4097-972e-83bf13c91b74 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:21:19 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-96015279-ab69-4097-972e-83bf13c91b74 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:21:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-96015279-ab69-4097-972e-83bf13c91b74 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-96015279-ab69-4097-972e-83bf13c91b74 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-96015279-ab69-4097-972e-83bf13c91b74 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-96015279-ab69-4097-972e-83bf13c91b74 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-96015279-ab69-4097-972e-83bf13c91b74 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-96015279-ab69-4097-972e-83bf13c91b74 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:19 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-96015279-ab69-4097-972e-83bf13c91b74 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:21:19 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-96015279-ab69-4097-972e-83bf13c91b74 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1730 microversion: 2.1 time: 0.344022 Apr 13 15:21:19 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 205/624] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:21:19 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1730 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:21:38 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=14 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:21:38 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:21:38 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-ae23dba0-fe7a-470d-b93c-85e42cbf8c41 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:21:38 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-ae23dba0-fe7a-470d-b93c-85e42cbf8c41 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:21:38 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ae23dba0-fe7a-470d-b93c-85e42cbf8c41 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:38 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ae23dba0-fe7a-470d-b93c-85e42cbf8c41 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:38 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ae23dba0-fe7a-470d-b93c-85e42cbf8c41 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:38 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ae23dba0-fe7a-470d-b93c-85e42cbf8c41 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:38 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ae23dba0-fe7a-470d-b93c-85e42cbf8c41 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:38 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ae23dba0-fe7a-470d-b93c-85e42cbf8c41 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:38 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-ae23dba0-fe7a-470d-b93c-85e42cbf8c41 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.158443 Apr 13 15:21:38 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 210/625] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:21:38 2023] GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162/os-volume_attachments => generated 25 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:21:38 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:21:38 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:21:38 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:21:38 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:21:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:38 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Going to try to terminate instance {{(pid=61873) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:21:38 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162" status: 204 len: 0 microversion: 2.1 time: 0.120982 Apr 13 15:21:38 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 211/626] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:21:38 2023] DELETE /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:21:38 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-9df9272d-d972-4c0b-819c-a9065331affd tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:21:38 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-9df9272d-d972-4c0b-819c-a9065331affd tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:21:38 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:21:38 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:21:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9df9272d-d972-4c0b-819c-a9065331affd tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9df9272d-d972-4c0b-819c-a9065331affd tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9df9272d-d972-4c0b-819c-a9065331affd tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9df9272d-d972-4c0b-819c-a9065331affd tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9df9272d-d972-4c0b-819c-a9065331affd tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:38 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9df9272d-d972-4c0b-819c-a9065331affd tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:38 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-9df9272d-d972-4c0b-819c-a9065331affd tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedd34ccc15c47f9a4fc96b080730acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3ba2d132c445039d0ae30ffd2bc64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:21:38 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-9df9272d-d972-4c0b-819c-a9065331affd tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162" status: 200 len: 1669 microversion: 2.1 time: 0.261718 Apr 13 15:21:38 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 206/627] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:21:38 2023] GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162 => generated 1669 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:21:38 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-5309694f-bb42-4870-bfd3-9fc826f6672d req-404ca7e5-a887-4c1a-b007-4eceb879f558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc146f3-9150-4920-b468-9aebcbc81162", "name": "network-vif-unplugged", "status": "completed", "tag": "8f16dd83-a089-414b-9525-cc7ef42c7331"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:21:38 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-5309694f-bb42-4870-bfd3-9fc826f6672d req-404ca7e5-a887-4c1a-b007-4eceb879f558 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:38 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-5309694f-bb42-4870-bfd3-9fc826f6672d req-404ca7e5-a887-4c1a-b007-4eceb879f558 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:38 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-5309694f-bb42-4870-bfd3-9fc826f6672d req-404ca7e5-a887-4c1a-b007-4eceb879f558 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:38 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-5309694f-bb42-4870-bfd3-9fc826f6672d req-404ca7e5-a887-4c1a-b007-4eceb879f558 service nova] Creating event network-vif-unplugged:8f16dd83-a089-414b-9525-cc7ef42c7331 for instance 3dc146f3-9150-4920-b468-9aebcbc81162 on user Apr 13 15:21:38 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-5309694f-bb42-4870-bfd3-9fc826f6672d req-404ca7e5-a887-4c1a-b007-4eceb879f558 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029571 Apr 13 15:21:38 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 211/628] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:21:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:21:40 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-7f2627bb-22a2-4742-8019-5b1af38f4a5f req-c3b5e7ac-edf6-45d2-8092-f5315161102b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc146f3-9150-4920-b468-9aebcbc81162", "name": "network-vif-deleted", "tag": "8f16dd83-a089-414b-9525-cc7ef42c7331"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:21:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-7f2627bb-22a2-4742-8019-5b1af38f4a5f req-c3b5e7ac-edf6-45d2-8092-f5315161102b service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-7f2627bb-22a2-4742-8019-5b1af38f4a5f req-c3b5e7ac-edf6-45d2-8092-f5315161102b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-7f2627bb-22a2-4742-8019-5b1af38f4a5f req-c3b5e7ac-edf6-45d2-8092-f5315161102b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:40 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-7f2627bb-22a2-4742-8019-5b1af38f4a5f req-c3b5e7ac-edf6-45d2-8092-f5315161102b service nova] Creating event network-vif-deleted:8f16dd83-a089-414b-9525-cc7ef42c7331 for instance 3dc146f3-9150-4920-b468-9aebcbc81162 on user Apr 13 15:21:40 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-7f2627bb-22a2-4742-8019-5b1af38f4a5f req-c3b5e7ac-edf6-45d2-8092-f5315161102b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032390 Apr 13 15:21:40 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 212/629] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:21:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:21:40 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-5fb30cbf-436e-4a79-abcd-70827c307dac tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:21:40 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-5fb30cbf-436e-4a79-abcd-70827c307dac tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:21:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5fb30cbf-436e-4a79-abcd-70827c307dac tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5fb30cbf-436e-4a79-abcd-70827c307dac tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5fb30cbf-436e-4a79-abcd-70827c307dac tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5fb30cbf-436e-4a79-abcd-70827c307dac tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5fb30cbf-436e-4a79-abcd-70827c307dac tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5fb30cbf-436e-4a79-abcd-70827c307dac tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:40 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-cb4d8242-ce13-439e-a7dd-aa2b3dd38913 req-7b28281d-2c70-49e2-b064-7e74950b91fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc146f3-9150-4920-b468-9aebcbc81162", "name": "network-vif-plugged", "status": "completed", "tag": "8f16dd83-a089-414b-9525-cc7ef42c7331"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:21:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-cb4d8242-ce13-439e-a7dd-aa2b3dd38913 req-7b28281d-2c70-49e2-b064-7e74950b91fb service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-cb4d8242-ce13-439e-a7dd-aa2b3dd38913 req-7b28281d-2c70-49e2-b064-7e74950b91fb service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:40 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-cb4d8242-ce13-439e-a7dd-aa2b3dd38913 req-7b28281d-2c70-49e2-b064-7e74950b91fb service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:40 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-cb4d8242-ce13-439e-a7dd-aa2b3dd38913 req-7b28281d-2c70-49e2-b064-7e74950b91fb service nova] Creating event network-vif-plugged:8f16dd83-a089-414b-9525-cc7ef42c7331 for instance 3dc146f3-9150-4920-b468-9aebcbc81162 on user Apr 13 15:21:40 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-cb4d8242-ce13-439e-a7dd-aa2b3dd38913 req-7b28281d-2c70-49e2-b064-7e74950b91fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031365 Apr 13 15:21:40 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 212/630] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:21:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:21:40 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-5fb30cbf-436e-4a79-abcd-70827c307dac tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.109279 Apr 13 15:21:40 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 207/631] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 15:21:40 2023] GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e/os-interface => generated 283 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:21:42 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:21:42 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:21:42 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:42 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:42 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:42 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:42 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:42 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:42 user devstack@n-api.service[61873]: DEBUG nova.objects.instance [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'services' on Instance uuid 8b883f51-b15c-42d7-b71a-e80c11e7d77e {{(pid=61873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:21:42 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e/os-volume_attachments/e0953e89-df86-47d7-9d9d-a5e263476027" status: 202 len: 0 microversion: 2.1 time: 0.170270 Apr 13 15:21:42 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 213/632] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:21:42 2023] DELETE /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e/os-volume_attachments/e0953e89-df86-47d7-9d9d-a5e263476027 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:21:42 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e6054f45-8f88-4f65-a9b3-18c2d5dd1818 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:21:42 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-e6054f45-8f88-4f65-a9b3-18c2d5dd1818 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:21:42 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e6054f45-8f88-4f65-a9b3-18c2d5dd1818 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:42 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e6054f45-8f88-4f65-a9b3-18c2d5dd1818 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:42 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e6054f45-8f88-4f65-a9b3-18c2d5dd1818 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:42 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e6054f45-8f88-4f65-a9b3-18c2d5dd1818 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:42 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e6054f45-8f88-4f65-a9b3-18c2d5dd1818 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:42 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e6054f45-8f88-4f65-a9b3-18c2d5dd1818 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:42 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-e6054f45-8f88-4f65-a9b3-18c2d5dd1818 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049624 Apr 13 15:21:42 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 213/633] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:21:42 2023] GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:21:42 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}, {"name": "network-changed", "server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:21:42 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:42 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:42 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:42 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] Creating event network-changed:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:21:42 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] Creating event network-changed:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:21:42 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.028769 Apr 13 15:21:42 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 208/634] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:21:42 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:21:45 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-386a07ef-0851-48d2-961a-d653a9dd7dcd tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:21:45 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-386a07ef-0851-48d2-961a-d653a9dd7dcd tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:21:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-386a07ef-0851-48d2-961a-d653a9dd7dcd tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-386a07ef-0851-48d2-961a-d653a9dd7dcd tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-386a07ef-0851-48d2-961a-d653a9dd7dcd tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-386a07ef-0851-48d2-961a-d653a9dd7dcd tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-386a07ef-0851-48d2-961a-d653a9dd7dcd tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-386a07ef-0851-48d2-961a-d653a9dd7dcd tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:45 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-386a07ef-0851-48d2-961a-d653a9dd7dcd tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.185004 Apr 13 15:21:45 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 214/635] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:21:45 2023] GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/os-volume_attachments => generated 25 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:21:45 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-c0c05bea-d454-4ee2-9902-4f49095ceb15 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:21:45 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-c0c05bea-d454-4ee2-9902-4f49095ceb15 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:21:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c0c05bea-d454-4ee2-9902-4f49095ceb15 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c0c05bea-d454-4ee2-9902-4f49095ceb15 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c0c05bea-d454-4ee2-9902-4f49095ceb15 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c0c05bea-d454-4ee2-9902-4f49095ceb15 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c0c05bea-d454-4ee2-9902-4f49095ceb15 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c0c05bea-d454-4ee2-9902-4f49095ceb15 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:45 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-c0c05bea-d454-4ee2-9902-4f49095ceb15 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] HTTP exception thrown: Instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe is not attached to volume 11a7881b-efa3-43da-9fd0-3e26df187b17 Apr 13 15:21:45 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-c0c05bea-d454-4ee2-9902-4f49095ceb15 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Request method failure captured: Apr 13 15:21:45 user devstack@n-api.service[61872]: request: DELETE /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/os-volume_attachments/11a7881b-efa3-43da-9fd0-3e26df187b17 HTTP/1.1 Apr 13 15:21:45 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:21:45 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:21:45 user devstack@n-api.service[61872]: Connection: close Apr 13 15:21:45 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:21:45 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:21:45 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:21:45 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:21:45 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:21:45 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBt_gL21F_HIzMNmMeHvCDxve6FeNon6Vk99gIHKSfsweejUx9M3I34NpTA5cEP08XCf4a9uHtu9GTiU0WZa1B6p4O_X0BvfGoqlTBj9g-4Mh1KzprzD4zd4ps5-GJJ6IZuEl19A1Oju4Qf83ExhOetXW2umxDR-fHhtcOVNSK_GmNs Apr 13 15:21:45 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:21:45 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:21:45 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:21:45 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:21:45 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:21:45 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:21:45 user devstack@n-api.service[61872]: X-Project-Id: 738150b0ec0c4ce887397f161c7e8c21 Apr 13 15:21:45 user devstack@n-api.service[61872]: X-Project-Name: tempest-TestMinimumBasicScenario-1239780022 Apr 13 15:21:45 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:21:45 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:21:45 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/738150b0ec0c4ce887397f161c7e8c21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738150b0ec0c4ce887397f161c7e8c21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738150b0ec0c4ce887397f161c7e8c21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:21:45 user devstack@n-api.service[61872]: X-Tenant: tempest-TestMinimumBasicScenario-1239780022 Apr 13 15:21:45 user devstack@n-api.service[61872]: X-Tenant-Id: 738150b0ec0c4ce887397f161c7e8c21 Apr 13 15:21:45 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1239780022 Apr 13 15:21:45 user devstack@n-api.service[61872]: X-User: tempest-TestMinimumBasicScenario-1239780022-project-member Apr 13 15:21:45 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:21:45 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:21:45 user devstack@n-api.service[61872]: X-User-Id: c2322f71af2a478291bfb9d34046394c Apr 13 15:21:45 user devstack@n-api.service[61872]: X-User-Name: tempest-TestMinimumBasicScenario-1239780022-project-member Apr 13 15:21:45 user devstack@n-api.service[61872]: method: > Apr 13 15:21:45 user devstack@n-api.service[61872]: exception: Instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe is not attached to volume 11a7881b-efa3-43da-9fd0-3e26df187b17 Apr 13 15:21:45 user devstack@n-api.service[61872]: action_args: {'server_id': 'e1c4cb29-65fa-4b48-b7a2-cac613cb96fe', 'id': '11a7881b-efa3-43da-9fd0-3e26df187b17'} Apr 13 15:21:45 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 11a7881b-efa3-43da-9fd0-3e26df187b17. Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe is not attached to volume 11a7881b-efa3-43da-9fd0-3e26df187b17 Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe is not attached to volume 11a7881b-efa3-43da-9fd0-3e26df187b17 Apr 13 15:21:45 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:21:45 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-c0c05bea-d454-4ee2-9902-4f49095ceb15 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Returning 404 to user: Instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe is not attached to volume 11a7881b-efa3-43da-9fd0-3e26df187b17 {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:21:45 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-c0c05bea-d454-4ee2-9902-4f49095ceb15 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/os-volume_attachments/11a7881b-efa3-43da-9fd0-3e26df187b17" status: 404 len: 154 microversion: 2.1 time: 0.086351 Apr 13 15:21:45 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 214/636] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:21:45 2023] DELETE /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/os-volume_attachments/11a7881b-efa3-43da-9fd0-3e26df187b17 => generated 154 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:21:46 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c2ad3835-23bb-437d-8ad0-2602695e5aa7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:21:46 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-c2ad3835-23bb-437d-8ad0-2602695e5aa7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:21:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c2ad3835-23bb-437d-8ad0-2602695e5aa7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c2ad3835-23bb-437d-8ad0-2602695e5aa7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c2ad3835-23bb-437d-8ad0-2602695e5aa7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c2ad3835-23bb-437d-8ad0-2602695e5aa7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c2ad3835-23bb-437d-8ad0-2602695e5aa7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c2ad3835-23bb-437d-8ad0-2602695e5aa7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:46 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-c2ad3835-23bb-437d-8ad0-2602695e5aa7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:21:46 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-c2ad3835-23bb-437d-8ad0-2602695e5aa7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:21:46 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-c2ad3835-23bb-437d-8ad0-2602695e5aa7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:21:46 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-c2ad3835-23bb-437d-8ad0-2602695e5aa7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f" status: 200 len: 1753 microversion: 2.87 time: 0.188854 Apr 13 15:21:46 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 209/637] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:21:46 2023] GET /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f => generated 1753 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:21:47 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:21:47 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:21:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:47 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Going to try to terminate instance {{(pid=61873) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:21:47 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" status: 204 len: 0 microversion: 2.1 time: 0.133710 Apr 13 15:21:47 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 215/638] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:21:47 2023] DELETE /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:21:47 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-565ad17d-a103-4395-9722-36364a708439 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:21:47 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-565ad17d-a103-4395-9722-36364a708439 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:21:47 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-565ad17d-a103-4395-9722-36364a708439 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:47 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-565ad17d-a103-4395-9722-36364a708439 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:47 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-565ad17d-a103-4395-9722-36364a708439 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:47 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-565ad17d-a103-4395-9722-36364a708439 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:47 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-565ad17d-a103-4395-9722-36364a708439 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:47 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-565ad17d-a103-4395-9722-36364a708439 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:48 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-565ad17d-a103-4395-9722-36364a708439 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:21:48 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-565ad17d-a103-4395-9722-36364a708439 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" status: 200 len: 1541 microversion: 2.1 time: 0.215611 Apr 13 15:21:48 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 215/639] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:21:47 2023] GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe => generated 1541 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:21:48 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-ec417077-9d3b-4118-a7b6-6f5cfdf9fd18 req-facfc3e9-53c6-460c-8174-e6a59166ffa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe", "name": "network-vif-unplugged", "status": "completed", "tag": "df99421e-bdc6-4fe5-9865-823bcb128ccc"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:21:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ec417077-9d3b-4118-a7b6-6f5cfdf9fd18 req-facfc3e9-53c6-460c-8174-e6a59166ffa6 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ec417077-9d3b-4118-a7b6-6f5cfdf9fd18 req-facfc3e9-53c6-460c-8174-e6a59166ffa6 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ec417077-9d3b-4118-a7b6-6f5cfdf9fd18 req-facfc3e9-53c6-460c-8174-e6a59166ffa6 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:48 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-ec417077-9d3b-4118-a7b6-6f5cfdf9fd18 req-facfc3e9-53c6-460c-8174-e6a59166ffa6 service nova] Creating event network-vif-unplugged:df99421e-bdc6-4fe5-9865-823bcb128ccc for instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe on user Apr 13 15:21:48 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-ec417077-9d3b-4118-a7b6-6f5cfdf9fd18 req-facfc3e9-53c6-460c-8174-e6a59166ffa6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028845 Apr 13 15:21:48 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 210/640] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:21:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:21:50 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-d6d045b9-c132-4481-a23d-e612682280c6 req-fcc5702d-ade8-4bc8-bdf1-a02a0f8bc4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe", "name": "network-vif-plugged", "status": "completed", "tag": "df99421e-bdc6-4fe5-9865-823bcb128ccc"}, {"server_uuid": "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe", "name": "network-vif-deleted", "tag": "df99421e-bdc6-4fe5-9865-823bcb128ccc"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:21:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d6d045b9-c132-4481-a23d-e612682280c6 req-fcc5702d-ade8-4bc8-bdf1-a02a0f8bc4b7 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:21:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d6d045b9-c132-4481-a23d-e612682280c6 req-fcc5702d-ade8-4bc8-bdf1-a02a0f8bc4b7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:21:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d6d045b9-c132-4481-a23d-e612682280c6 req-fcc5702d-ade8-4bc8-bdf1-a02a0f8bc4b7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:21:50 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-d6d045b9-c132-4481-a23d-e612682280c6 req-fcc5702d-ade8-4bc8-bdf1-a02a0f8bc4b7 service nova] Creating event network-vif-plugged:df99421e-bdc6-4fe5-9865-823bcb128ccc for instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe on user Apr 13 15:21:50 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-d6d045b9-c132-4481-a23d-e612682280c6 req-fcc5702d-ade8-4bc8-bdf1-a02a0f8bc4b7 service nova] Creating event network-vif-deleted:df99421e-bdc6-4fe5-9865-823bcb128ccc for instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe on user Apr 13 15:21:50 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-d6d045b9-c132-4481-a23d-e612682280c6 req-fcc5702d-ade8-4bc8-bdf1-a02a0f8bc4b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031816 Apr 13 15:21:50 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 216/641] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:21:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:22:11 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d47a2be4-49e7-477a-9257-b47853d8fa61 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:22:11 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-d47a2be4-49e7-477a-9257-b47853d8fa61 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:22:11 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=12 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:22:11 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=28 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:22:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d47a2be4-49e7-477a-9257-b47853d8fa61 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d47a2be4-49e7-477a-9257-b47853d8fa61 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d47a2be4-49e7-477a-9257-b47853d8fa61 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d47a2be4-49e7-477a-9257-b47853d8fa61 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d47a2be4-49e7-477a-9257-b47853d8fa61 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d47a2be4-49e7-477a-9257-b47853d8fa61 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:11 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-d47a2be4-49e7-477a-9257-b47853d8fa61 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057127 Apr 13 15:22:11 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 216/642] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:22:11 2023] GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:22:11 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=12 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:22:11 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=20 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:22:11 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:22:11 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:22:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:11 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Going to try to terminate instance {{(pid=61871) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:22:11 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3" status: 204 len: 0 microversion: 2.1 time: 0.126080 Apr 13 15:22:11 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 211/643] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:22:11 2023] DELETE /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:22:11 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:22:11 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:22:11 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c793d938-6142-4e15-925c-13b56bc8bc42 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:22:11 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-c793d938-6142-4e15-925c-13b56bc8bc42 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:22:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c793d938-6142-4e15-925c-13b56bc8bc42 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c793d938-6142-4e15-925c-13b56bc8bc42 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c793d938-6142-4e15-925c-13b56bc8bc42 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c793d938-6142-4e15-925c-13b56bc8bc42 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c793d938-6142-4e15-925c-13b56bc8bc42 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c793d938-6142-4e15-925c-13b56bc8bc42 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:11 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-c793d938-6142-4e15-925c-13b56bc8bc42 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1a698b103a47c0b2864eef54be648b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceba33821a9b4f7aa81c2857c11261f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:22:11 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-c793d938-6142-4e15-925c-13b56bc8bc42 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3" status: 200 len: 1660 microversion: 2.1 time: 0.198309 Apr 13 15:22:11 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 217/644] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:22:11 2023] GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3 => generated 1660 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:22:11 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-a6327054-62b7-478b-95c0-fe5d7f5c0813 req-fb0af8ae-4cdc-4d6e-9cdd-bea172702bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa74d14-db6f-41f5-b8af-32da312209d3", "name": "network-vif-unplugged", "status": "completed", "tag": "84611f06-d6ca-49e1-afe7-7723921e62dc"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:22:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a6327054-62b7-478b-95c0-fe5d7f5c0813 req-fb0af8ae-4cdc-4d6e-9cdd-bea172702bbe service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a6327054-62b7-478b-95c0-fe5d7f5c0813 req-fb0af8ae-4cdc-4d6e-9cdd-bea172702bbe service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a6327054-62b7-478b-95c0-fe5d7f5c0813 req-fb0af8ae-4cdc-4d6e-9cdd-bea172702bbe service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:11 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-a6327054-62b7-478b-95c0-fe5d7f5c0813 req-fb0af8ae-4cdc-4d6e-9cdd-bea172702bbe service nova] Creating event network-vif-unplugged:84611f06-d6ca-49e1-afe7-7723921e62dc for instance 1aa74d14-db6f-41f5-b8af-32da312209d3 on user Apr 13 15:22:11 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-a6327054-62b7-478b-95c0-fe5d7f5c0813 req-fb0af8ae-4cdc-4d6e-9cdd-bea172702bbe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028080 Apr 13 15:22:11 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 217/645] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:22:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:22:13 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-a2ed172b-d574-46eb-9aef-34e1577d403d req-e09bc171-cef5-493f-a7eb-7d1f29d83ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa74d14-db6f-41f5-b8af-32da312209d3", "name": "network-vif-deleted", "tag": "84611f06-d6ca-49e1-afe7-7723921e62dc"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:22:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a2ed172b-d574-46eb-9aef-34e1577d403d req-e09bc171-cef5-493f-a7eb-7d1f29d83ce1 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a2ed172b-d574-46eb-9aef-34e1577d403d req-e09bc171-cef5-493f-a7eb-7d1f29d83ce1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a2ed172b-d574-46eb-9aef-34e1577d403d req-e09bc171-cef5-493f-a7eb-7d1f29d83ce1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:13 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-a2ed172b-d574-46eb-9aef-34e1577d403d req-e09bc171-cef5-493f-a7eb-7d1f29d83ce1 service nova] Creating event network-vif-deleted:84611f06-d6ca-49e1-afe7-7723921e62dc for instance 1aa74d14-db6f-41f5-b8af-32da312209d3 on user Apr 13 15:22:13 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-a2ed172b-d574-46eb-9aef-34e1577d403d req-e09bc171-cef5-493f-a7eb-7d1f29d83ce1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028201 Apr 13 15:22:13 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 212/646] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:22:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:22:13 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-c4878b2f-2b9e-435c-8417-0da50cb2d626 req-b6c08d35-98d3-41d8-98dc-36d8549c6565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa74d14-db6f-41f5-b8af-32da312209d3", "name": "network-vif-plugged", "status": "completed", "tag": "84611f06-d6ca-49e1-afe7-7723921e62dc"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:22:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c4878b2f-2b9e-435c-8417-0da50cb2d626 req-b6c08d35-98d3-41d8-98dc-36d8549c6565 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c4878b2f-2b9e-435c-8417-0da50cb2d626 req-b6c08d35-98d3-41d8-98dc-36d8549c6565 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c4878b2f-2b9e-435c-8417-0da50cb2d626 req-b6c08d35-98d3-41d8-98dc-36d8549c6565 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:13 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-c4878b2f-2b9e-435c-8417-0da50cb2d626 req-b6c08d35-98d3-41d8-98dc-36d8549c6565 service nova] Creating event network-vif-plugged:84611f06-d6ca-49e1-afe7-7723921e62dc for instance 1aa74d14-db6f-41f5-b8af-32da312209d3 on user Apr 13 15:22:13 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-c4878b2f-2b9e-435c-8417-0da50cb2d626 req-b6c08d35-98d3-41d8-98dc-36d8549c6565 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027652 Apr 13 15:22:13 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 218/647] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:22:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:22:19 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:22:19 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:22:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:19 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/action" status: 202 len: 0 microversion: 2.1 time: 0.163367 Apr 13 15:22:19 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 218/648] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:22:19 2023] POST /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:22:19 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-eb3a204d-ecd0-4bd7-a49b-a133dc58c406 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:22:19 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-eb3a204d-ecd0-4bd7-a49b-a133dc58c406 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:22:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-eb3a204d-ecd0-4bd7-a49b-a133dc58c406 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-eb3a204d-ecd0-4bd7-a49b-a133dc58c406 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-eb3a204d-ecd0-4bd7-a49b-a133dc58c406 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-eb3a204d-ecd0-4bd7-a49b-a133dc58c406 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-eb3a204d-ecd0-4bd7-a49b-a133dc58c406 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-eb3a204d-ecd0-4bd7-a49b-a133dc58c406 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:20 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-eb3a204d-ecd0-4bd7-a49b-a133dc58c406 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:22:20 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-eb3a204d-ecd0-4bd7-a49b-a133dc58c406 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1729 microversion: 2.1 time: 0.294053 Apr 13 15:22:20 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 213/649] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:22:19 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1729 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 15:22:20 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-7b41b849-a592-400d-9334-f2189056c56f req-08d1b424-208e-47e3-87f9-8ee543a15ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b5bd-5f78-448e-bd82-74b2263dff75", "name": "network-vif-unplugged", "status": "completed", "tag": "9c8ad360-aa62-4ef1-952f-d73f885baa89"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:22:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-7b41b849-a592-400d-9334-f2189056c56f req-08d1b424-208e-47e3-87f9-8ee543a15ac4 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-7b41b849-a592-400d-9334-f2189056c56f req-08d1b424-208e-47e3-87f9-8ee543a15ac4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-7b41b849-a592-400d-9334-f2189056c56f req-08d1b424-208e-47e3-87f9-8ee543a15ac4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:20 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-7b41b849-a592-400d-9334-f2189056c56f req-08d1b424-208e-47e3-87f9-8ee543a15ac4 service nova] Creating event network-vif-unplugged:9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 on user Apr 13 15:22:20 user devstack@n-api.service[61873]: DEBUG nova.compute.api [req-7b41b849-a592-400d-9334-f2189056c56f req-08d1b424-208e-47e3-87f9-8ee543a15ac4 service nova] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61873) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 15:22:20 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-7b41b849-a592-400d-9334-f2189056c56f req-08d1b424-208e-47e3-87f9-8ee543a15ac4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039578 Apr 13 15:22:20 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 219/650] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:22:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:22:22 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-5394d0e6-c4ff-4ab1-8251-00f5e77dd39a req-3eba52dd-0520-4772-a473-914b307ab4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b5bd-5f78-448e-bd82-74b2263dff75", "name": "network-vif-plugged", "status": "completed", "tag": "9c8ad360-aa62-4ef1-952f-d73f885baa89"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:22:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-5394d0e6-c4ff-4ab1-8251-00f5e77dd39a req-3eba52dd-0520-4772-a473-914b307ab4e3 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-5394d0e6-c4ff-4ab1-8251-00f5e77dd39a req-3eba52dd-0520-4772-a473-914b307ab4e3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-5394d0e6-c4ff-4ab1-8251-00f5e77dd39a req-3eba52dd-0520-4772-a473-914b307ab4e3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:22 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-5394d0e6-c4ff-4ab1-8251-00f5e77dd39a req-3eba52dd-0520-4772-a473-914b307ab4e3 service nova] Creating event network-vif-plugged:9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 on user Apr 13 15:22:22 user devstack@n-api.service[61872]: DEBUG nova.compute.api [req-5394d0e6-c4ff-4ab1-8251-00f5e77dd39a req-3eba52dd-0520-4772-a473-914b307ab4e3 service nova] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 15:22:22 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-5394d0e6-c4ff-4ab1-8251-00f5e77dd39a req-3eba52dd-0520-4772-a473-914b307ab4e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036518 Apr 13 15:22:22 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 219/651] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:22:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:22:28 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-14e0df48-44d5-4b7a-8c2b-a3f3e4cd4f34 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:22:28 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-14e0df48-44d5-4b7a-8c2b-a3f3e4cd4f34 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:22:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-14e0df48-44d5-4b7a-8c2b-a3f3e4cd4f34 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-14e0df48-44d5-4b7a-8c2b-a3f3e4cd4f34 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-14e0df48-44d5-4b7a-8c2b-a3f3e4cd4f34 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-14e0df48-44d5-4b7a-8c2b-a3f3e4cd4f34 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-14e0df48-44d5-4b7a-8c2b-a3f3e4cd4f34 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-14e0df48-44d5-4b7a-8c2b-a3f3e4cd4f34 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:28 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-14e0df48-44d5-4b7a-8c2b-a3f3e4cd4f34 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] HTTP exception thrown: Instance 3dc146f3-9150-4920-b468-9aebcbc81162 could not be found. Apr 13 15:22:28 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-14e0df48-44d5-4b7a-8c2b-a3f3e4cd4f34 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Request method failure captured: Apr 13 15:22:28 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162 HTTP/1.1 Apr 13 15:22:28 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:22:28 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:22:28 user devstack@n-api.service[61871]: Connection: close Apr 13 15:22:28 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:22:28 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:22:28 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:22:28 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:22:28 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:22:28 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBysJSC_pL1o3J9cVhCfPJH0RJxZJE2XjaF2Yq1nITqHQPAUJ-sY0C6ehk0hgyb5AGui4kwa-lWhEaqyW-11oCzt4s9SAjj7iiHUYBf3mDz8zQD6VpCcWxM23IvnmM9hydVYLDDtvrzvCJbTCSuVNPu3nJmaP7WJ6HL0s88zCkG70Us Apr 13 15:22:28 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:22:28 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:22:28 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:22:28 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:22:28 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:22:28 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:22:28 user devstack@n-api.service[61871]: X-Project-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:22:28 user devstack@n-api.service[61871]: X-Project-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:22:28 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:22:28 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:22:28 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:22:28 user devstack@n-api.service[61871]: X-Tenant: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:22:28 user devstack@n-api.service[61871]: X-Tenant-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:22:28 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:22:28 user devstack@n-api.service[61871]: X-User: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:22:28 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:22:28 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:22:28 user devstack@n-api.service[61871]: X-User-Id: fedd34ccc15c47f9a4fc96b080730acd Apr 13 15:22:28 user devstack@n-api.service[61871]: X-User-Name: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:22:28 user devstack@n-api.service[61871]: method: > Apr 13 15:22:28 user devstack@n-api.service[61871]: exception: Instance 3dc146f3-9150-4920-b468-9aebcbc81162 could not be found. Apr 13 15:22:28 user devstack@n-api.service[61871]: action_args: {'id': '3dc146f3-9150-4920-b468-9aebcbc81162'} Apr 13 15:22:28 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc146f3-9150-4920-b468-9aebcbc81162 could not be found. Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc146f3-9150-4920-b468-9aebcbc81162 could not be found. Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc146f3-9150-4920-b468-9aebcbc81162 could not be found. Apr 13 15:22:28 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:22:28 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-14e0df48-44d5-4b7a-8c2b-a3f3e4cd4f34 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Returning 404 to user: Instance 3dc146f3-9150-4920-b468-9aebcbc81162 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:22:28 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-14e0df48-44d5-4b7a-8c2b-a3f3e4cd4f34 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162" status: 404 len: 111 microversion: 2.1 time: 0.031320 Apr 13 15:22:28 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 214/652] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:22:28 2023] GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:22:28 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-ead329d6-2f99-4a4d-8677-953caa999046 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '.version_select at 0x7f3a8b809630>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:22:28 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-ead329d6-2f99-4a4d-8677-953caa999046 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984106079" status: 202 len: 0 microversion: 2.1 time: 0.023172 Apr 13 15:22:28 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 220/653] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 15:22:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984106079 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:22:29 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-b9a6e922-8801-41ed-b2de-bfe152972534 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Action: 'create', calling method: .version_select at 0x7f3a8fa5f130>, body: {"keypair": {"name": "tempest-keypair-2093832726", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCah+9H+8jh4CmJxEHYVZOlBpAJ3gCxsuGIfaDmRJo2gMuNYJKtf1qSAj9IJYkaI4lz+2Iyyk5h4jh7yZiU15svcNNYGaS/rHTOvo5L88SXHT9jfFzTOEqZvhKmOknO7Vg=="}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:22:29 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-b9a6e922-8801-41ed-b2de-bfe152972534 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting quotas for project 3e3ba2d132c445039d0ae30ffd2bc64a. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:22:29 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-b9a6e922-8801-41ed-b2de-bfe152972534 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting quotas for user fedd34ccc15c47f9a4fc96b080730acd and project 3e3ba2d132c445039d0ae30ffd2bc64a. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:22:29 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-b9a6e922-8801-41ed-b2de-bfe152972534 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070536 Apr 13 15:22:29 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 220/654] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 15:22:29 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-462259660", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "547bb22a-22b3-4b8b-ab87-e4eb4af27619"}], "security_groups": [{"name": "tempest-securitygroup--1233980773"}], "key_name": "tempest-keypair-2093832726", "user_data": "}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] validate_networks() for [('547bb22a-22b3-4b8b-ab87-e4eb4af27619', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting quotas for project 3e3ba2d132c445039d0ae30ffd2bc64a. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting quotas for user fedd34ccc15c47f9a4fc96b080730acd and project 3e3ba2d132c445039d0ae30ffd2bc64a. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:22:32 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=12 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:22:32 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-67502af8-e51d-40db-944a-b40526f4a69f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:22:32 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-67502af8-e51d-40db-944a-b40526f4a69f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:22:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-67502af8-e51d-40db-944a-b40526f4a69f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-67502af8-e51d-40db-944a-b40526f4a69f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-67502af8-e51d-40db-944a-b40526f4a69f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-67502af8-e51d-40db-944a-b40526f4a69f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-67502af8-e51d-40db-944a-b40526f4a69f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-67502af8-e51d-40db-944a-b40526f4a69f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:32 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.773338 Apr 13 15:22:32 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 215/655] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:22:32 2023] POST /compute/v2.1/servers => generated 400 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:22:32 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:22:32 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-385d69cb-0bcf-42a6-96eb-806ebfaf5a51 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:22:32 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-385d69cb-0bcf-42a6-96eb-806ebfaf5a51 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:22:32 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-67502af8-e51d-40db-944a-b40526f4a69f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067961 Apr 13 15:22:32 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 221/656] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:22:32 2023] GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:32 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-385d69cb-0bcf-42a6-96eb-806ebfaf5a51 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedd34ccc15c47f9a4fc96b080730acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3ba2d132c445039d0ae30ffd2bc64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:22:32 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-385d69cb-0bcf-42a6-96eb-806ebfaf5a51 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e" status: 200 len: 1235 microversion: 2.1 time: 0.164004 Apr 13 15:22:32 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 221/657] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:22:32 2023] GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e => generated 1235 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:22:33 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Going to try to terminate instance {{(pid=61871) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:22:33 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e" status: 204 len: 0 microversion: 2.1 time: 0.188378 Apr 13 15:22:33 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 216/658] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:22:32 2023] DELETE /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:22:33 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-37220cee-241c-4b8f-a393-f8fa7edef7cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:22:33 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-37220cee-241c-4b8f-a393-f8fa7edef7cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:22:33 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-e5b93338-6772-4b2a-b42f-6d8c059c7f1d req-daf0c073-e7b0-4f21-95bd-90641d07ad80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b5bd-5f78-448e-bd82-74b2263dff75", "name": "network-vif-plugged", "status": "completed", "tag": "9c8ad360-aa62-4ef1-952f-d73f885baa89"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:22:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-37220cee-241c-4b8f-a393-f8fa7edef7cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-37220cee-241c-4b8f-a393-f8fa7edef7cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-37220cee-241c-4b8f-a393-f8fa7edef7cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-37220cee-241c-4b8f-a393-f8fa7edef7cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-37220cee-241c-4b8f-a393-f8fa7edef7cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-37220cee-241c-4b8f-a393-f8fa7edef7cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-e5b93338-6772-4b2a-b42f-6d8c059c7f1d req-daf0c073-e7b0-4f21-95bd-90641d07ad80 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-e5b93338-6772-4b2a-b42f-6d8c059c7f1d req-daf0c073-e7b0-4f21-95bd-90641d07ad80 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-e5b93338-6772-4b2a-b42f-6d8c059c7f1d req-daf0c073-e7b0-4f21-95bd-90641d07ad80 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:33 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-e5b93338-6772-4b2a-b42f-6d8c059c7f1d req-daf0c073-e7b0-4f21-95bd-90641d07ad80 service nova] Creating event network-vif-plugged:9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 on user Apr 13 15:22:33 user devstack@n-api.service[61872]: DEBUG nova.compute.api [req-e5b93338-6772-4b2a-b42f-6d8c059c7f1d req-daf0c073-e7b0-4f21-95bd-90641d07ad80 service nova] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 15:22:33 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-e5b93338-6772-4b2a-b42f-6d8c059c7f1d req-daf0c073-e7b0-4f21-95bd-90641d07ad80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044643 Apr 13 15:22:33 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 222/659] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:22:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:22:33 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-37220cee-241c-4b8f-a393-f8fa7edef7cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:22:33 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-37220cee-241c-4b8f-a393-f8fa7edef7cc tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e" status: 200 len: 1678 microversion: 2.1 time: 0.328665 Apr 13 15:22:33 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 222/660] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:22:33 2023] GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e => generated 1678 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:22:33 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-9da0e89e-d14a-4ab9-ae80-df3c2a3116cb req-4a0cefd4-fb5b-40de-ad61-8c4cb71b0265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "name": "network-vif-unplugged", "status": "completed", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:22:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-9da0e89e-d14a-4ab9-ae80-df3c2a3116cb req-4a0cefd4-fb5b-40de-ad61-8c4cb71b0265 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-9da0e89e-d14a-4ab9-ae80-df3c2a3116cb req-4a0cefd4-fb5b-40de-ad61-8c4cb71b0265 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-9da0e89e-d14a-4ab9-ae80-df3c2a3116cb req-4a0cefd4-fb5b-40de-ad61-8c4cb71b0265 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:33 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-9da0e89e-d14a-4ab9-ae80-df3c2a3116cb req-4a0cefd4-fb5b-40de-ad61-8c4cb71b0265 service nova] Creating event network-vif-unplugged:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:22:33 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-9da0e89e-d14a-4ab9-ae80-df3c2a3116cb req-4a0cefd4-fb5b-40de-ad61-8c4cb71b0265 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037354 Apr 13 15:22:33 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 217/661] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:22:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:22:35 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-2b9b2993-f0fa-4b31-877b-a99e8009eb35 req-650a0e82-3837-4cbb-825f-8f75e108fc34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b5bd-5f78-448e-bd82-74b2263dff75", "name": "network-vif-plugged", "status": "completed", "tag": "9c8ad360-aa62-4ef1-952f-d73f885baa89"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:22:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-2b9b2993-f0fa-4b31-877b-a99e8009eb35 req-650a0e82-3837-4cbb-825f-8f75e108fc34 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-2b9b2993-f0fa-4b31-877b-a99e8009eb35 req-650a0e82-3837-4cbb-825f-8f75e108fc34 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-2b9b2993-f0fa-4b31-877b-a99e8009eb35 req-650a0e82-3837-4cbb-825f-8f75e108fc34 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:35 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-2b9b2993-f0fa-4b31-877b-a99e8009eb35 req-650a0e82-3837-4cbb-825f-8f75e108fc34 service nova] Creating event network-vif-plugged:9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 on user Apr 13 15:22:35 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-2b9b2993-f0fa-4b31-877b-a99e8009eb35 req-650a0e82-3837-4cbb-825f-8f75e108fc34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033498 Apr 13 15:22:35 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 223/662] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:22:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:22:35 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-5f05f13d-8144-4034-800a-d4809307a5d2 req-5e0224e1-399b-4c22-bcb2-53b3138afbb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "name": "network-vif-plugged", "status": "completed", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}, {"server_uuid": "8b883f51-b15c-42d7-b71a-e80c11e7d77e", "name": "network-vif-deleted", "tag": "6343df00-b9ef-49a6-be1e-69f12895910f"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:22:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5f05f13d-8144-4034-800a-d4809307a5d2 req-5e0224e1-399b-4c22-bcb2-53b3138afbb3 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5f05f13d-8144-4034-800a-d4809307a5d2 req-5e0224e1-399b-4c22-bcb2-53b3138afbb3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5f05f13d-8144-4034-800a-d4809307a5d2 req-5e0224e1-399b-4c22-bcb2-53b3138afbb3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:35 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-5f05f13d-8144-4034-800a-d4809307a5d2 req-5e0224e1-399b-4c22-bcb2-53b3138afbb3 service nova] Creating event network-vif-plugged:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:22:35 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-5f05f13d-8144-4034-800a-d4809307a5d2 req-5e0224e1-399b-4c22-bcb2-53b3138afbb3 service nova] Creating event network-vif-deleted:6343df00-b9ef-49a6-be1e-69f12895910f for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e on user Apr 13 15:22:35 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-5f05f13d-8144-4034-800a-d4809307a5d2 req-5e0224e1-399b-4c22-bcb2-53b3138afbb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031868 Apr 13 15:22:35 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 223/663] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:22:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:22:37 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-5a15a781-f9ae-48b6-9b7e-d4aab7302f1d req-7e58eef5-1300-4f9e-a976-56e705856c0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a68333-dc4d-48d9-84c6-4c7cd515853e", "tag": "714a062f-8189-4905-b41f-619554697056"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:22:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-5a15a781-f9ae-48b6-9b7e-d4aab7302f1d req-7e58eef5-1300-4f9e-a976-56e705856c0c service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-5a15a781-f9ae-48b6-9b7e-d4aab7302f1d req-7e58eef5-1300-4f9e-a976-56e705856c0c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-5a15a781-f9ae-48b6-9b7e-d4aab7302f1d req-7e58eef5-1300-4f9e-a976-56e705856c0c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:37 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-5a15a781-f9ae-48b6-9b7e-d4aab7302f1d req-7e58eef5-1300-4f9e-a976-56e705856c0c service nova] Creating event network-changed:714a062f-8189-4905-b41f-619554697056 for instance 75a68333-dc4d-48d9-84c6-4c7cd515853e on user Apr 13 15:22:37 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-5a15a781-f9ae-48b6-9b7e-d4aab7302f1d req-7e58eef5-1300-4f9e-a976-56e705856c0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064788 Apr 13 15:22:37 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 218/664] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:22:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:22:37 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-cf50e3d8-bdec-482b-b884-d78de9d8e365 req-2ae30d2a-419a-4408-92b4-93534489f949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a68333-dc4d-48d9-84c6-4c7cd515853e", "name": "network-vif-plugged", "status": "completed", "tag": "714a062f-8189-4905-b41f-619554697056"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:22:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-cf50e3d8-bdec-482b-b884-d78de9d8e365 req-2ae30d2a-419a-4408-92b4-93534489f949 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-cf50e3d8-bdec-482b-b884-d78de9d8e365 req-2ae30d2a-419a-4408-92b4-93534489f949 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-cf50e3d8-bdec-482b-b884-d78de9d8e365 req-2ae30d2a-419a-4408-92b4-93534489f949 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:37 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-cf50e3d8-bdec-482b-b884-d78de9d8e365 req-2ae30d2a-419a-4408-92b4-93534489f949 service nova] Creating event network-vif-plugged:714a062f-8189-4905-b41f-619554697056 for instance 75a68333-dc4d-48d9-84c6-4c7cd515853e on user Apr 13 15:22:37 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-cf50e3d8-bdec-482b-b884-d78de9d8e365 req-2ae30d2a-419a-4408-92b4-93534489f949 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035099 Apr 13 15:22:37 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 224/665] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:22:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:22:38 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-dfdaa4c3-925e-41af-a8ae-0efc13703285 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:22:38 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-dfdaa4c3-925e-41af-a8ae-0efc13703285 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:22:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-dfdaa4c3-925e-41af-a8ae-0efc13703285 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-dfdaa4c3-925e-41af-a8ae-0efc13703285 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-dfdaa4c3-925e-41af-a8ae-0efc13703285 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-dfdaa4c3-925e-41af-a8ae-0efc13703285 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-dfdaa4c3-925e-41af-a8ae-0efc13703285 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-dfdaa4c3-925e-41af-a8ae-0efc13703285 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:38 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-dfdaa4c3-925e-41af-a8ae-0efc13703285 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] HTTP exception thrown: Instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe could not be found. Apr 13 15:22:38 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-dfdaa4c3-925e-41af-a8ae-0efc13703285 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Request method failure captured: Apr 13 15:22:38 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe HTTP/1.1 Apr 13 15:22:38 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:22:38 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:22:38 user devstack@n-api.service[61873]: Connection: close Apr 13 15:22:38 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:22:38 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:22:38 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:22:38 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:22:38 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:22:38 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBt_gL21F_HIzMNmMeHvCDxve6FeNon6Vk99gIHKSfsweejUx9M3I34NpTA5cEP08XCf4a9uHtu9GTiU0WZa1B6p4O_X0BvfGoqlTBj9g-4Mh1KzprzD4zd4ps5-GJJ6IZuEl19A1Oju4Qf83ExhOetXW2umxDR-fHhtcOVNSK_GmNs Apr 13 15:22:38 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:22:38 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:22:38 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:22:38 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:22:38 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:22:38 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:22:38 user devstack@n-api.service[61873]: X-Project-Id: 738150b0ec0c4ce887397f161c7e8c21 Apr 13 15:22:38 user devstack@n-api.service[61873]: X-Project-Name: tempest-TestMinimumBasicScenario-1239780022 Apr 13 15:22:38 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:22:38 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:22:38 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/738150b0ec0c4ce887397f161c7e8c21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738150b0ec0c4ce887397f161c7e8c21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738150b0ec0c4ce887397f161c7e8c21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:22:38 user devstack@n-api.service[61873]: X-Tenant: tempest-TestMinimumBasicScenario-1239780022 Apr 13 15:22:38 user devstack@n-api.service[61873]: X-Tenant-Id: 738150b0ec0c4ce887397f161c7e8c21 Apr 13 15:22:38 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1239780022 Apr 13 15:22:38 user devstack@n-api.service[61873]: X-User: tempest-TestMinimumBasicScenario-1239780022-project-member Apr 13 15:22:38 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:22:38 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:22:38 user devstack@n-api.service[61873]: X-User-Id: c2322f71af2a478291bfb9d34046394c Apr 13 15:22:38 user devstack@n-api.service[61873]: X-User-Name: tempest-TestMinimumBasicScenario-1239780022-project-member Apr 13 15:22:38 user devstack@n-api.service[61873]: method: > Apr 13 15:22:38 user devstack@n-api.service[61873]: exception: Instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe could not be found. Apr 13 15:22:38 user devstack@n-api.service[61873]: action_args: {'id': 'e1c4cb29-65fa-4b48-b7a2-cac613cb96fe'} Apr 13 15:22:38 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe could not be found. Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe could not be found. Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe could not be found. Apr 13 15:22:38 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:22:38 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-dfdaa4c3-925e-41af-a8ae-0efc13703285 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Returning 404 to user: Instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:22:38 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-dfdaa4c3-925e-41af-a8ae-0efc13703285 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" status: 404 len: 111 microversion: 2.1 time: 0.047288 Apr 13 15:22:38 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 224/666] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:22:38 2023] GET /compute/v2.1/servers/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:22:38 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-da5e5533-dd36-4ec7-a4ec-54b607bd4a51 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Calling method '.version_select at 0x7f3a8f875120>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:22:38 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-da5e5533-dd36-4ec7-a4ec-54b607bd4a51 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1152073766" status: 202 len: 0 microversion: 2.1 time: 0.030853 Apr 13 15:22:38 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 219/667] 10.0.0.210 () {62 vars in 1349 bytes} [Thu Apr 13 15:22:38 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1152073766 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:22:39 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-e0e04e81-4981-4d4d-b3e0-8db9de51d201 req-710920d7-3ad2-4055-b82d-acb6141a9111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a68333-dc4d-48d9-84c6-4c7cd515853e", "name": "network-vif-plugged", "status": "completed", "tag": "714a062f-8189-4905-b41f-619554697056"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:22:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-e0e04e81-4981-4d4d-b3e0-8db9de51d201 req-710920d7-3ad2-4055-b82d-acb6141a9111 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-e0e04e81-4981-4d4d-b3e0-8db9de51d201 req-710920d7-3ad2-4055-b82d-acb6141a9111 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-e0e04e81-4981-4d4d-b3e0-8db9de51d201 req-710920d7-3ad2-4055-b82d-acb6141a9111 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:39 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-e0e04e81-4981-4d4d-b3e0-8db9de51d201 req-710920d7-3ad2-4055-b82d-acb6141a9111 service nova] Creating event network-vif-plugged:714a062f-8189-4905-b41f-619554697056 for instance 75a68333-dc4d-48d9-84c6-4c7cd515853e on user Apr 13 15:22:40 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-e0e04e81-4981-4d4d-b3e0-8db9de51d201 req-710920d7-3ad2-4055-b82d-acb6141a9111 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028811 Apr 13 15:22:40 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 225/668] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:22:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:22:46 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-a2899e85-1af0-4dc3-8b75-7679ae4b209d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:22:46 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-a2899e85-1af0-4dc3-8b75-7679ae4b209d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:22:46 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:22:46 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a2899e85-1af0-4dc3-8b75-7679ae4b209d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:46 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a2899e85-1af0-4dc3-8b75-7679ae4b209d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:46 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a2899e85-1af0-4dc3-8b75-7679ae4b209d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:46 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a2899e85-1af0-4dc3-8b75-7679ae4b209d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:46 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a2899e85-1af0-4dc3-8b75-7679ae4b209d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:46 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a2899e85-1af0-4dc3-8b75-7679ae4b209d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:46 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-a2899e85-1af0-4dc3-8b75-7679ae4b209d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/action" status: 202 len: 0 microversion: 2.87 time: 0.081243 Apr 13 15:22:46 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 225/669] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 15:22:46 2023] POST /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:22:46 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:22:46 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:22:46 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-9cf507d0-2450-4462-8404-71c6e2d01fcd tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:22:46 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-9cf507d0-2450-4462-8404-71c6e2d01fcd tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:22:46 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:22:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9cf507d0-2450-4462-8404-71c6e2d01fcd tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9cf507d0-2450-4462-8404-71c6e2d01fcd tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9cf507d0-2450-4462-8404-71c6e2d01fcd tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9cf507d0-2450-4462-8404-71c6e2d01fcd tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9cf507d0-2450-4462-8404-71c6e2d01fcd tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9cf507d0-2450-4462-8404-71c6e2d01fcd tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:46 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:22:47 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-9cf507d0-2450-4462-8404-71c6e2d01fcd tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:22:47 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-9cf507d0-2450-4462-8404-71c6e2d01fcd tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:22:47 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-9cf507d0-2450-4462-8404-71c6e2d01fcd tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:22:47 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-9cf507d0-2450-4462-8404-71c6e2d01fcd tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f" status: 200 len: 1761 microversion: 2.87 time: 0.321129 Apr 13 15:22:47 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 220/670] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:22:46 2023] GET /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f => generated 1761 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:22:47 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:22:47 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-bb408e9f-d568-44d7-b81e-101a36efc632 req-ad1c1ed9-1832-4314-8660-210ea16b7fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c609c1d1-edcf-4b71-abea-5dd95ebcd81f", "name": "network-vif-unplugged", "status": "completed", "tag": "92d492eb-f3b6-4481-b492-949cf7eabd1a"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:22:47 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:22:47 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-bb408e9f-d568-44d7-b81e-101a36efc632 req-ad1c1ed9-1832-4314-8660-210ea16b7fc4 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:47 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-bb408e9f-d568-44d7-b81e-101a36efc632 req-ad1c1ed9-1832-4314-8660-210ea16b7fc4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:47 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-bb408e9f-d568-44d7-b81e-101a36efc632 req-ad1c1ed9-1832-4314-8660-210ea16b7fc4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:47 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-bb408e9f-d568-44d7-b81e-101a36efc632 req-ad1c1ed9-1832-4314-8660-210ea16b7fc4 service nova] Creating event network-vif-unplugged:92d492eb-f3b6-4481-b492-949cf7eabd1a for instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f on user Apr 13 15:22:47 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-bb408e9f-d568-44d7-b81e-101a36efc632 req-ad1c1ed9-1832-4314-8660-210ea16b7fc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042150 Apr 13 15:22:47 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 226/671] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:22:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:22:49 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-b0ae72cf-e72e-40b8-b4ea-bb00f4e177d6 req-07f6faaa-c97d-41a5-abde-5cedc7fddfde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c609c1d1-edcf-4b71-abea-5dd95ebcd81f", "name": "network-vif-plugged", "status": "completed", "tag": "92d492eb-f3b6-4481-b492-949cf7eabd1a"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:22:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b0ae72cf-e72e-40b8-b4ea-bb00f4e177d6 req-07f6faaa-c97d-41a5-abde-5cedc7fddfde service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b0ae72cf-e72e-40b8-b4ea-bb00f4e177d6 req-07f6faaa-c97d-41a5-abde-5cedc7fddfde service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b0ae72cf-e72e-40b8-b4ea-bb00f4e177d6 req-07f6faaa-c97d-41a5-abde-5cedc7fddfde service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:49 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-b0ae72cf-e72e-40b8-b4ea-bb00f4e177d6 req-07f6faaa-c97d-41a5-abde-5cedc7fddfde service nova] Creating event network-vif-plugged:92d492eb-f3b6-4481-b492-949cf7eabd1a for instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f on user Apr 13 15:22:49 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-b0ae72cf-e72e-40b8-b4ea-bb00f4e177d6 req-07f6faaa-c97d-41a5-abde-5cedc7fddfde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030705 Apr 13 15:22:49 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 226/672] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:22:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:22:51 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-ea3a2d73-a626-4cfb-bfe6-cde116a61bad req-3f16141d-ae8c-4bad-8a8f-a5d5e80b272e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c609c1d1-edcf-4b71-abea-5dd95ebcd81f", "name": "network-vif-plugged", "status": "completed", "tag": "92d492eb-f3b6-4481-b492-949cf7eabd1a"}, {"server_uuid": "c609c1d1-edcf-4b71-abea-5dd95ebcd81f", "name": "network-vif-plugged", "status": "completed", "tag": "92d492eb-f3b6-4481-b492-949cf7eabd1a"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:22:51 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ea3a2d73-a626-4cfb-bfe6-cde116a61bad req-3f16141d-ae8c-4bad-8a8f-a5d5e80b272e service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:22:51 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ea3a2d73-a626-4cfb-bfe6-cde116a61bad req-3f16141d-ae8c-4bad-8a8f-a5d5e80b272e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:22:51 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ea3a2d73-a626-4cfb-bfe6-cde116a61bad req-3f16141d-ae8c-4bad-8a8f-a5d5e80b272e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:22:51 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-ea3a2d73-a626-4cfb-bfe6-cde116a61bad req-3f16141d-ae8c-4bad-8a8f-a5d5e80b272e service nova] Creating event network-vif-plugged:92d492eb-f3b6-4481-b492-949cf7eabd1a for instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f on user Apr 13 15:22:51 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-ea3a2d73-a626-4cfb-bfe6-cde116a61bad req-3f16141d-ae8c-4bad-8a8f-a5d5e80b272e service nova] Creating event network-vif-plugged:92d492eb-f3b6-4481-b492-949cf7eabd1a for instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f on user Apr 13 15:22:51 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-ea3a2d73-a626-4cfb-bfe6-cde116a61bad req-3f16141d-ae8c-4bad-8a8f-a5d5e80b272e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.194033 Apr 13 15:22:51 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 221/673] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:22:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:23:01 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=12 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:23:01 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-95628257-4375-4ffa-b0f1-3e581b8c0bed tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Action: 'create', calling method: .version_select at 0x7f3a8f7948b0>, body: {"keypair": {"name": "tempest-TestStampPattern-1982719940", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAksZCequnPeyEoxbRX4FTqaIZECithWpaNGXiycVZEBPtiDQC3OzUbnYo2ImPDa8dvWI39XTOjrHTgd99yZNpia3NMbHa+IllMmi0NURtQ7qbFcLr5JTdfFUpnNv2P7uA=="}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:23:01 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-95628257-4375-4ffa-b0f1-3e581b8c0bed tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Getting quotas for project 318b9e0eb6a745df811d1daa4d6195fc. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:23:01 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-95628257-4375-4ffa-b0f1-3e581b8c0bed tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Getting quotas for user 78e289648c244c77ab9ca48154da3cde and project 318b9e0eb6a745df811d1daa4d6195fc. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:23:01 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-95628257-4375-4ffa-b0f1-3e581b8c0bed tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.253750 Apr 13 15:23:01 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 227/674] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 15:23:01 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:23:01 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=3 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:23:01 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:23:01 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-86e11330-d60d-4d6e-a75e-a3f82de1705e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:23:01 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-86e11330-d60d-4d6e-a75e-a3f82de1705e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:23:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-86e11330-d60d-4d6e-a75e-a3f82de1705e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-86e11330-d60d-4d6e-a75e-a3f82de1705e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-86e11330-d60d-4d6e-a75e-a3f82de1705e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-86e11330-d60d-4d6e-a75e-a3f82de1705e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-86e11330-d60d-4d6e-a75e-a3f82de1705e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-86e11330-d60d-4d6e-a75e-a3f82de1705e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:01 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-86e11330-d60d-4d6e-a75e-a3f82de1705e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] HTTP exception thrown: Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 could not be found. Apr 13 15:23:01 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-86e11330-d60d-4d6e-a75e-a3f82de1705e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Request method failure captured: Apr 13 15:23:01 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3 HTTP/1.1 Apr 13 15:23:01 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:23:01 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:23:01 user devstack@n-api.service[61873]: Connection: close Apr 13 15:23:01 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:23:01 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:23:01 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:23:01 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:23:01 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:23:01 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBvow86gKNivuTB6ogWrqnOwepE4zg3bO1TSkkhG4US5BzkcqviMiBl4o_Y72I8KnOpJNzaOP0L4BvBiTe4UMLYWqP2o1bg1BxN5lSjLigwpexmFWGaKRti0NJVFmd6pOG0hkt4lffEJudP_49AuScJSlFQVBzmFpGiyd60BhSgssJk Apr 13 15:23:01 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:23:01 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:23:01 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:23:01 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:23:01 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:23:01 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:23:01 user devstack@n-api.service[61873]: X-Project-Id: ceba33821a9b4f7aa81c2857c11261f1 Apr 13 15:23:01 user devstack@n-api.service[61873]: X-Project-Name: tempest-AttachVolumeTestJSON-157319562 Apr 13 15:23:01 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:23:01 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:23:01 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ceba33821a9b4f7aa81c2857c11261f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ceba33821a9b4f7aa81c2857c11261f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ceba33821a9b4f7aa81c2857c11261f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:23:01 user devstack@n-api.service[61873]: X-Tenant: tempest-AttachVolumeTestJSON-157319562 Apr 13 15:23:01 user devstack@n-api.service[61873]: X-Tenant-Id: ceba33821a9b4f7aa81c2857c11261f1 Apr 13 15:23:01 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-AttachVolumeTestJSON-157319562 Apr 13 15:23:01 user devstack@n-api.service[61873]: X-User: tempest-AttachVolumeTestJSON-157319562-project-member Apr 13 15:23:01 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:23:01 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:23:01 user devstack@n-api.service[61873]: X-User-Id: de1a698b103a47c0b2864eef54be648b Apr 13 15:23:01 user devstack@n-api.service[61873]: X-User-Name: tempest-AttachVolumeTestJSON-157319562-project-member Apr 13 15:23:01 user devstack@n-api.service[61873]: method: > Apr 13 15:23:01 user devstack@n-api.service[61873]: exception: Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 could not be found. Apr 13 15:23:01 user devstack@n-api.service[61873]: action_args: {'id': '1aa74d14-db6f-41f5-b8af-32da312209d3'} Apr 13 15:23:01 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 could not be found. Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 could not be found. Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 could not be found. Apr 13 15:23:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:23:01 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-86e11330-d60d-4d6e-a75e-a3f82de1705e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Returning 404 to user: Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:23:01 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-86e11330-d60d-4d6e-a75e-a3f82de1705e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3" status: 404 len: 111 microversion: 2.1 time: 0.034720 Apr 13 15:23:01 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 227/675] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:23:01 2023] GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:23:01 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-ee2308f9-a38f-475f-b8af-e33881833a9f tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '.version_select at 0x7f3a8f877010>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:23:01 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-ee2308f9-a38f-475f-b8af-e33881833a9f tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-668401822" status: 202 len: 0 microversion: 2.1 time: 0.043408 Apr 13 15:23:01 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 222/676] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 15:23:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-668401822 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:23:02 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-2db07297-d2ba-4912-890b-418407c1e073 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Action: 'create', calling method: .version_select at 0x7f3a8f7972e0>, body: {"keypair": {"name": "tempest-keypair-1855443748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdTSuvMCCSoO8gEL+Y4LzWCT6AMVJXqlSXautXO8WYI89z5mAhSWOc9+LI3QBpLskYzTiUPYNLmXCHJhNKKLvGDwdUolY7+TdNY3npIh3wlWQQVeSyeE6ZEta6F1YhiDA=="}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:23:02 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-2db07297-d2ba-4912-890b-418407c1e073 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Getting quotas for project ceba33821a9b4f7aa81c2857c11261f1. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:23:02 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-2db07297-d2ba-4912-890b-418407c1e073 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Getting quotas for user de1a698b103a47c0b2864eef54be648b and project ceba33821a9b4f7aa81c2857c11261f1. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:23:02 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-2db07297-d2ba-4912-890b-418407c1e073 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047465 Apr 13 15:23:02 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 228/677] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 15:23:02 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1518437861", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "9e196c6b-274c-477b-9f83-c526ca47c2a0"}], "security_groups": [{"name": "tempest-securitygroup--837130201"}], "key_name": "tempest-keypair-1855443748", "user_data": "}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG nova.network.neutron [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] validate_networks() for [('9e196c6b-274c-477b-9f83-c526ca47c2a0', None, None, None, None, None)] {{(pid=61873) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:23:04 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=7 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:23:04 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-220855040", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1982719940", "security_groups": [{"name": "tempest-secgroup-smoke-894451483"}], "networks": [{"uuid": "b494185f-1f0c-4027-8633-d536f480c6d6"}]}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:23:04 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] validate_networks() for [('b494185f-1f0c-4027-8633-d536f480c6d6', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Flavor limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Image limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Flavor pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Image pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Getting quotas for project ceba33821a9b4f7aa81c2857c11261f1. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Getting quotas for user de1a698b103a47c0b2864eef54be648b and project ceba33821a9b4f7aa81c2857c11261f1. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Going to run 1 instances... {{(pid=61873) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:23:04 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.544105 Apr 13 15:23:04 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 228/678] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:23:04 2023] POST /compute/v2.1/servers => generated 399 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:23:04 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-fe5d153e-6e7e-4352-87ed-ddbd2c01e721 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:23:04 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-fe5d153e-6e7e-4352-87ed-ddbd2c01e721 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:23:04 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-fe5d153e-6e7e-4352-87ed-ddbd2c01e721 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1a698b103a47c0b2864eef54be648b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceba33821a9b4f7aa81c2857c11261f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:23:04 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-fe5d153e-6e7e-4352-87ed-ddbd2c01e721 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a" status: 200 len: 1232 microversion: 2.1 time: 0.069507 Apr 13 15:23:04 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 229/679] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:23:04 2023] GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a => generated 1232 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:23:04 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:23:04 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:23:04 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:23:04 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:23:04 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:23:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:04 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Getting quotas for project 318b9e0eb6a745df811d1daa4d6195fc. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:23:04 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Getting quotas for user 78e289648c244c77ab9ca48154da3cde and project 318b9e0eb6a745df811d1daa4d6195fc. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:23:04 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:23:04 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:23:04 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.677521 Apr 13 15:23:04 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 223/680] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:23:04 2023] POST /compute/v2.1/servers => generated 403 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-5ba96f5b-0b9a-4b2f-90aa-a92a66389032 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-5ba96f5b-0b9a-4b2f-90aa-a92a66389032 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:23:04 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-5ba96f5b-0b9a-4b2f-90aa-a92a66389032 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e289648c244c77ab9ca48154da3cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318b9e0eb6a745df811d1daa4d6195fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:23:04 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-5ba96f5b-0b9a-4b2f-90aa-a92a66389032 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95" status: 200 len: 1236 microversion: 2.1 time: 0.067855 Apr 13 15:23:04 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 229/681] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:23:04 2023] GET /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95 => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:23:07 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-39ab201e-aa4a-4922-ab64-6c3407fb6023 req-3db57c19-d078-42a8-a1f4-f3d2842bd3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f093cc8b-83cd-4154-8b4e-a98481e2c42a", "tag": "1ef64389-9092-411b-a2cf-f0ad923650c5"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:23:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-39ab201e-aa4a-4922-ab64-6c3407fb6023 req-3db57c19-d078-42a8-a1f4-f3d2842bd3f8 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-39ab201e-aa4a-4922-ab64-6c3407fb6023 req-3db57c19-d078-42a8-a1f4-f3d2842bd3f8 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-39ab201e-aa4a-4922-ab64-6c3407fb6023 req-3db57c19-d078-42a8-a1f4-f3d2842bd3f8 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:07 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-39ab201e-aa4a-4922-ab64-6c3407fb6023 req-3db57c19-d078-42a8-a1f4-f3d2842bd3f8 service nova] Creating event network-changed:1ef64389-9092-411b-a2cf-f0ad923650c5 for instance f093cc8b-83cd-4154-8b4e-a98481e2c42a on user Apr 13 15:23:07 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-39ab201e-aa4a-4922-ab64-6c3407fb6023 req-3db57c19-d078-42a8-a1f4-f3d2842bd3f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089498 Apr 13 15:23:07 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 230/682] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:23:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:23:07 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-d8327b6a-89f0-47d1-80ef-e4a363fbaf8c req-3e4459f6-503b-4206-ae54-8a2a790a4796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42464137-e247-4191-8ed4-4bbdbe392f95", "tag": "2fcc3406-d672-49a1-85b8-5f2ce187b541"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:23:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-d8327b6a-89f0-47d1-80ef-e4a363fbaf8c req-3e4459f6-503b-4206-ae54-8a2a790a4796 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-d8327b6a-89f0-47d1-80ef-e4a363fbaf8c req-3e4459f6-503b-4206-ae54-8a2a790a4796 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-d8327b6a-89f0-47d1-80ef-e4a363fbaf8c req-3e4459f6-503b-4206-ae54-8a2a790a4796 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:07 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-d8327b6a-89f0-47d1-80ef-e4a363fbaf8c req-3e4459f6-503b-4206-ae54-8a2a790a4796 service nova] Creating event network-changed:2fcc3406-d672-49a1-85b8-5f2ce187b541 for instance 42464137-e247-4191-8ed4-4bbdbe392f95 on user Apr 13 15:23:07 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-d8327b6a-89f0-47d1-80ef-e4a363fbaf8c req-3e4459f6-503b-4206-ae54-8a2a790a4796 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103160 Apr 13 15:23:07 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 224/683] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:23:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:23:10 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-cba7391b-d252-4ba2-bbf5-bdcf5514ae4d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:23:10 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-cba7391b-d252-4ba2-bbf5-bdcf5514ae4d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:23:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cba7391b-d252-4ba2-bbf5-bdcf5514ae4d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cba7391b-d252-4ba2-bbf5-bdcf5514ae4d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cba7391b-d252-4ba2-bbf5-bdcf5514ae4d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cba7391b-d252-4ba2-bbf5-bdcf5514ae4d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cba7391b-d252-4ba2-bbf5-bdcf5514ae4d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cba7391b-d252-4ba2-bbf5-bdcf5514ae4d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:10 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-f15e76a8-1ade-4115-ac30-22a08f1c0a50 req-138ca901-caee-4645-98f7-29ab62f418a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f093cc8b-83cd-4154-8b4e-a98481e2c42a", "name": "network-vif-plugged", "status": "completed", "tag": "1ef64389-9092-411b-a2cf-f0ad923650c5"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:23:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f15e76a8-1ade-4115-ac30-22a08f1c0a50 req-138ca901-caee-4645-98f7-29ab62f418a8 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f15e76a8-1ade-4115-ac30-22a08f1c0a50 req-138ca901-caee-4645-98f7-29ab62f418a8 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f15e76a8-1ade-4115-ac30-22a08f1c0a50 req-138ca901-caee-4645-98f7-29ab62f418a8 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:10 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-f15e76a8-1ade-4115-ac30-22a08f1c0a50 req-138ca901-caee-4645-98f7-29ab62f418a8 service nova] Creating event network-vif-plugged:1ef64389-9092-411b-a2cf-f0ad923650c5 for instance f093cc8b-83cd-4154-8b4e-a98481e2c42a on user Apr 13 15:23:10 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-f15e76a8-1ade-4115-ac30-22a08f1c0a50 req-138ca901-caee-4645-98f7-29ab62f418a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036869 Apr 13 15:23:10 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 231/684] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:23:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:23:10 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-cba7391b-d252-4ba2-bbf5-bdcf5514ae4d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:23:10 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-cba7391b-d252-4ba2-bbf5-bdcf5514ae4d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1722 microversion: 2.1 time: 0.164871 Apr 13 15:23:10 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 230/685] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:23:10 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:23:10 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-3e81a012-c9bd-460e-965f-0b7e350f7716 req-2992e1be-bf10-464b-9465-85f78d6a5a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42464137-e247-4191-8ed4-4bbdbe392f95", "name": "network-vif-plugged", "status": "completed", "tag": "2fcc3406-d672-49a1-85b8-5f2ce187b541"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:23:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-3e81a012-c9bd-460e-965f-0b7e350f7716 req-2992e1be-bf10-464b-9465-85f78d6a5a2d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-3e81a012-c9bd-460e-965f-0b7e350f7716 req-2992e1be-bf10-464b-9465-85f78d6a5a2d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-3e81a012-c9bd-460e-965f-0b7e350f7716 req-2992e1be-bf10-464b-9465-85f78d6a5a2d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:10 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-3e81a012-c9bd-460e-965f-0b7e350f7716 req-2992e1be-bf10-464b-9465-85f78d6a5a2d service nova] Creating event network-vif-plugged:2fcc3406-d672-49a1-85b8-5f2ce187b541 for instance 42464137-e247-4191-8ed4-4bbdbe392f95 on user Apr 13 15:23:10 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-3e81a012-c9bd-460e-965f-0b7e350f7716 req-2992e1be-bf10-464b-9465-85f78d6a5a2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039621 Apr 13 15:23:10 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 225/686] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:23:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:23:12 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-9e801c9d-18d2-46b8-aae2-fce9fc578fad req-470aebbf-6149-4aa3-b768-a7cce39f6ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f093cc8b-83cd-4154-8b4e-a98481e2c42a", "name": "network-vif-plugged", "status": "completed", "tag": "1ef64389-9092-411b-a2cf-f0ad923650c5"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:23:12 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-9e801c9d-18d2-46b8-aae2-fce9fc578fad req-470aebbf-6149-4aa3-b768-a7cce39f6ffe service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:12 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-9e801c9d-18d2-46b8-aae2-fce9fc578fad req-470aebbf-6149-4aa3-b768-a7cce39f6ffe service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:12 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-9e801c9d-18d2-46b8-aae2-fce9fc578fad req-470aebbf-6149-4aa3-b768-a7cce39f6ffe service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:12 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-9e801c9d-18d2-46b8-aae2-fce9fc578fad req-470aebbf-6149-4aa3-b768-a7cce39f6ffe service nova] Creating event network-vif-plugged:1ef64389-9092-411b-a2cf-f0ad923650c5 for instance f093cc8b-83cd-4154-8b4e-a98481e2c42a on user Apr 13 15:23:12 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-9e801c9d-18d2-46b8-aae2-fce9fc578fad req-470aebbf-6149-4aa3-b768-a7cce39f6ffe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027143 Apr 13 15:23:12 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 232/687] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:23:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:23:12 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-08de6a90-02fc-4490-9989-03493214a6a0 req-5d8e5f1e-dbd9-48a0-91f7-2bc86727aad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42464137-e247-4191-8ed4-4bbdbe392f95", "name": "network-vif-plugged", "status": "completed", "tag": "2fcc3406-d672-49a1-85b8-5f2ce187b541"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:23:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-08de6a90-02fc-4490-9989-03493214a6a0 req-5d8e5f1e-dbd9-48a0-91f7-2bc86727aad8 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-08de6a90-02fc-4490-9989-03493214a6a0 req-5d8e5f1e-dbd9-48a0-91f7-2bc86727aad8 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-08de6a90-02fc-4490-9989-03493214a6a0 req-5d8e5f1e-dbd9-48a0-91f7-2bc86727aad8 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:12 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-08de6a90-02fc-4490-9989-03493214a6a0 req-5d8e5f1e-dbd9-48a0-91f7-2bc86727aad8 service nova] Creating event network-vif-plugged:2fcc3406-d672-49a1-85b8-5f2ce187b541 for instance 42464137-e247-4191-8ed4-4bbdbe392f95 on user Apr 13 15:23:12 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-08de6a90-02fc-4490-9989-03493214a6a0 req-5d8e5f1e-dbd9-48a0-91f7-2bc86727aad8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032786 Apr 13 15:23:12 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 231/688] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:23:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:23:23 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:23:23 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:23:23 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:23:23 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:23:23 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-7cd06471-fd99-48bd-b545-5a42db81962b tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:23:23 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-7cd06471-fd99-48bd-b545-5a42db81962b tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:23:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7cd06471-fd99-48bd-b545-5a42db81962b tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7cd06471-fd99-48bd-b545-5a42db81962b tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7cd06471-fd99-48bd-b545-5a42db81962b tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7cd06471-fd99-48bd-b545-5a42db81962b tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7cd06471-fd99-48bd-b545-5a42db81962b tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7cd06471-fd99-48bd-b545-5a42db81962b tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:23 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-7cd06471-fd99-48bd-b545-5a42db81962b tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedd34ccc15c47f9a4fc96b080730acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3ba2d132c445039d0ae30ffd2bc64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:23:23 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-7cd06471-fd99-48bd-b545-5a42db81962b tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e" status: 200 len: 1546 microversion: 2.1 time: 0.159191 Apr 13 15:23:23 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 226/689] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:23:23 2023] GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e => generated 1546 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:23:23 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=10 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:23:23 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:23:23 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:23:23 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d0f9f48d-1a82-4f75-860e-33548cd4a4f4 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:23:23 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-d0f9f48d-1a82-4f75-860e-33548cd4a4f4 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:23:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d0f9f48d-1a82-4f75-860e-33548cd4a4f4 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d0f9f48d-1a82-4f75-860e-33548cd4a4f4 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d0f9f48d-1a82-4f75-860e-33548cd4a4f4 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d0f9f48d-1a82-4f75-860e-33548cd4a4f4 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d0f9f48d-1a82-4f75-860e-33548cd4a4f4 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d0f9f48d-1a82-4f75-860e-33548cd4a4f4 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:23 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-d0f9f48d-1a82-4f75-860e-33548cd4a4f4 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] HTTP exception thrown: Instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e could not be found. Apr 13 15:23:23 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d0f9f48d-1a82-4f75-860e-33548cd4a4f4 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Request method failure captured: Apr 13 15:23:23 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e HTTP/1.1 Apr 13 15:23:23 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:23:23 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:23:23 user devstack@n-api.service[61872]: Connection: close Apr 13 15:23:23 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:23:23 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:23:23 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:23:23 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:23:23 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:23:23 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBqsGdw3aycWoeNTF5dIwz9M4XoihFvfDydEnbooAOgxqZE-k6qSuH5o67HiM2sVa6RcOyUtIsnkDUaPOUoPWZlOnWwrJAmh2HS8sFequPAvZEFaKGsiH5QLqfUXGyfRHGhNYdseVYaXNX3DzwjC8qCRhoxAP0-nP_gTeqRe2MpQXfI Apr 13 15:23:23 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:23:23 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:23:23 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:23:23 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:23:23 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:23:23 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:23:23 user devstack@n-api.service[61872]: X-Project-Id: 9bad96fcfa0d4691af2a7990ba9dbd09 Apr 13 15:23:23 user devstack@n-api.service[61872]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-66620130 Apr 13 15:23:23 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:23:23 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:23:23 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9bad96fcfa0d4691af2a7990ba9dbd09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bad96fcfa0d4691af2a7990ba9dbd09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bad96fcfa0d4691af2a7990ba9dbd09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:23:23 user devstack@n-api.service[61872]: X-Tenant: tempest-ServerRescueNegativeTestJSON-66620130 Apr 13 15:23:23 user devstack@n-api.service[61872]: X-Tenant-Id: 9bad96fcfa0d4691af2a7990ba9dbd09 Apr 13 15:23:23 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-66620130 Apr 13 15:23:23 user devstack@n-api.service[61872]: X-User: tempest-ServerRescueNegativeTestJSON-66620130-project-member Apr 13 15:23:23 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:23:23 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:23:23 user devstack@n-api.service[61872]: X-User-Id: c83940ddaaf64d94b40df9d00349aa91 Apr 13 15:23:23 user devstack@n-api.service[61872]: X-User-Name: tempest-ServerRescueNegativeTestJSON-66620130-project-member Apr 13 15:23:23 user devstack@n-api.service[61872]: method: > Apr 13 15:23:23 user devstack@n-api.service[61872]: exception: Instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e could not be found. Apr 13 15:23:23 user devstack@n-api.service[61872]: action_args: {'id': '8b883f51-b15c-42d7-b71a-e80c11e7d77e'} Apr 13 15:23:23 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e could not be found. Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e could not be found. Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e could not be found. Apr 13 15:23:23 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:23:23 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d0f9f48d-1a82-4f75-860e-33548cd4a4f4 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Returning 404 to user: Instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:23:23 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-d0f9f48d-1a82-4f75-860e-33548cd4a4f4 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e" status: 404 len: 111 microversion: 2.1 time: 0.038038 Apr 13 15:23:23 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 233/690] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:23:23 2023] GET /compute/v2.1/servers/8b883f51-b15c-42d7-b71a-e80c11e7d77e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:23:23 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:23:23 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=8 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:23:23 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:23:23 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=12 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:23:23 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f0cffb8a-86a1-48e1-9549-93fa76f307c6 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '.version_select at 0x7f3a8b7c0ca0>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:23:23 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-f0cffb8a-86a1-48e1-9549-93fa76f307c6 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516441123" status: 202 len: 0 microversion: 2.1 time: 0.039501 Apr 13 15:23:23 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 232/691] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 15:23:23 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516441123 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:23:28 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:23:28 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:23:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:28 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Going to try to terminate instance {{(pid=61871) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:23:28 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/25f57234-8818-44d3-b476-d6cfba7b2810" status: 204 len: 0 microversion: 2.1 time: 0.114918 Apr 13 15:23:28 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 227/692] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:23:28 2023] DELETE /compute/v2.1/servers/25f57234-8818-44d3-b476-d6cfba7b2810 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:23:28 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-dc21ad03-af01-4c49-8144-12fa8daaaac7 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:23:28 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-dc21ad03-af01-4c49-8144-12fa8daaaac7 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:23:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-dc21ad03-af01-4c49-8144-12fa8daaaac7 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-dc21ad03-af01-4c49-8144-12fa8daaaac7 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-dc21ad03-af01-4c49-8144-12fa8daaaac7 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-dc21ad03-af01-4c49-8144-12fa8daaaac7 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-dc21ad03-af01-4c49-8144-12fa8daaaac7 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-dc21ad03-af01-4c49-8144-12fa8daaaac7 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:29 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-dc21ad03-af01-4c49-8144-12fa8daaaac7 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:23:29 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-dc21ad03-af01-4c49-8144-12fa8daaaac7 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25f57234-8818-44d3-b476-d6cfba7b2810" status: 200 len: 1495 microversion: 2.1 time: 0.228438 Apr 13 15:23:29 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 234/693] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:23:28 2023] GET /compute/v2.1/servers/25f57234-8818-44d3-b476-d6cfba7b2810 => generated 1495 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:23:29 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-7c919430-011e-4778-b111-1fdb3996ad82 req-ef5813fc-fe61-43a7-9816-70d8995ff0bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f57234-8818-44d3-b476-d6cfba7b2810", "name": "network-vif-unplugged", "status": "completed", "tag": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:23:29 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-7c919430-011e-4778-b111-1fdb3996ad82 req-ef5813fc-fe61-43a7-9816-70d8995ff0bd service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:29 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-7c919430-011e-4778-b111-1fdb3996ad82 req-ef5813fc-fe61-43a7-9816-70d8995ff0bd service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:29 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-7c919430-011e-4778-b111-1fdb3996ad82 req-ef5813fc-fe61-43a7-9816-70d8995ff0bd service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:29 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-7c919430-011e-4778-b111-1fdb3996ad82 req-ef5813fc-fe61-43a7-9816-70d8995ff0bd service nova] Creating event network-vif-unplugged:e4b886a7-88e3-42e3-98b8-b0fa9d67391a for instance 25f57234-8818-44d3-b476-d6cfba7b2810 on user Apr 13 15:23:29 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-7c919430-011e-4778-b111-1fdb3996ad82 req-ef5813fc-fe61-43a7-9816-70d8995ff0bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030479 Apr 13 15:23:29 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 233/694] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:23:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:23:31 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-3c1ee205-e3de-417e-a6c9-7ef35f3108c6 req-1c64f328-d570-43cc-85f7-60e6ccf21b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f57234-8818-44d3-b476-d6cfba7b2810", "name": "network-vif-plugged", "status": "completed", "tag": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a"}, {"server_uuid": "25f57234-8818-44d3-b476-d6cfba7b2810", "name": "network-vif-deleted", "tag": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:23:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-3c1ee205-e3de-417e-a6c9-7ef35f3108c6 req-1c64f328-d570-43cc-85f7-60e6ccf21b4b service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-3c1ee205-e3de-417e-a6c9-7ef35f3108c6 req-1c64f328-d570-43cc-85f7-60e6ccf21b4b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-3c1ee205-e3de-417e-a6c9-7ef35f3108c6 req-1c64f328-d570-43cc-85f7-60e6ccf21b4b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:31 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-3c1ee205-e3de-417e-a6c9-7ef35f3108c6 req-1c64f328-d570-43cc-85f7-60e6ccf21b4b service nova] Creating event network-vif-plugged:e4b886a7-88e3-42e3-98b8-b0fa9d67391a for instance 25f57234-8818-44d3-b476-d6cfba7b2810 on user Apr 13 15:23:31 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-3c1ee205-e3de-417e-a6c9-7ef35f3108c6 req-1c64f328-d570-43cc-85f7-60e6ccf21b4b service nova] Creating event network-vif-deleted:e4b886a7-88e3-42e3-98b8-b0fa9d67391a for instance 25f57234-8818-44d3-b476-d6cfba7b2810 on user Apr 13 15:23:31 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-3c1ee205-e3de-417e-a6c9-7ef35f3108c6 req-1c64f328-d570-43cc-85f7-60e6ccf21b4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049977 Apr 13 15:23:31 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 228/695] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:23:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:23:37 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-085a8ffe-0ec3-4ce4-b297-50994076500d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:23:37 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-085a8ffe-0ec3-4ce4-b297-50994076500d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:23:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-085a8ffe-0ec3-4ce4-b297-50994076500d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-085a8ffe-0ec3-4ce4-b297-50994076500d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-085a8ffe-0ec3-4ce4-b297-50994076500d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-085a8ffe-0ec3-4ce4-b297-50994076500d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-085a8ffe-0ec3-4ce4-b297-50994076500d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-085a8ffe-0ec3-4ce4-b297-50994076500d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:37 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-085a8ffe-0ec3-4ce4-b297-50994076500d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:23:37 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-085a8ffe-0ec3-4ce4-b297-50994076500d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:23:37 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-085a8ffe-0ec3-4ce4-b297-50994076500d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:23:37 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-085a8ffe-0ec3-4ce4-b297-50994076500d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f" status: 200 len: 1767 microversion: 2.87 time: 0.156172 Apr 13 15:23:37 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 235/696] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:23:37 2023] GET /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f => generated 1767 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:23:54 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:23:54 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:23:54 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-fb19fcbc-ce11-4399-bd7a-29ee5fe50a78 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:23:54 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-fb19fcbc-ce11-4399-bd7a-29ee5fe50a78 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:23:54 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fb19fcbc-ce11-4399-bd7a-29ee5fe50a78 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:54 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fb19fcbc-ce11-4399-bd7a-29ee5fe50a78 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:54 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fb19fcbc-ce11-4399-bd7a-29ee5fe50a78 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:54 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fb19fcbc-ce11-4399-bd7a-29ee5fe50a78 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:54 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fb19fcbc-ce11-4399-bd7a-29ee5fe50a78 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:54 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fb19fcbc-ce11-4399-bd7a-29ee5fe50a78 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:54 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-fb19fcbc-ce11-4399-bd7a-29ee5fe50a78 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1a698b103a47c0b2864eef54be648b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceba33821a9b4f7aa81c2857c11261f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:23:54 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-fb19fcbc-ce11-4399-bd7a-29ee5fe50a78 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a" status: 200 len: 1537 microversion: 2.1 time: 0.215053 Apr 13 15:23:54 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 234/697] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:23:54 2023] GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a => generated 1537 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:23:54 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-e581620e-b1e8-47a2-8853-90a206b00701 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:23:54 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-e581620e-b1e8-47a2-8853-90a206b00701 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:23:54 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:23:54 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:23:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e581620e-b1e8-47a2-8853-90a206b00701 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e581620e-b1e8-47a2-8853-90a206b00701 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e581620e-b1e8-47a2-8853-90a206b00701 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e581620e-b1e8-47a2-8853-90a206b00701 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:23:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e581620e-b1e8-47a2-8853-90a206b00701 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:23:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e581620e-b1e8-47a2-8853-90a206b00701 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:23:55 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-e581620e-b1e8-47a2-8853-90a206b00701 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e289648c244c77ab9ca48154da3cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318b9e0eb6a745df811d1daa4d6195fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:23:55 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-e581620e-b1e8-47a2-8853-90a206b00701 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95" status: 200 len: 1537 microversion: 2.1 time: 0.172093 Apr 13 15:23:55 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 229/698] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:23:54 2023] GET /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95 => generated 1537 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:24:10 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-3878eb61-07c1-4cca-86a1-5c0a33e38eaf tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:24:10 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-3878eb61-07c1-4cca-86a1-5c0a33e38eaf tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:24:10 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=14 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:24:10 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=8 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:24:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3878eb61-07c1-4cca-86a1-5c0a33e38eaf tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3878eb61-07c1-4cca-86a1-5c0a33e38eaf tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3878eb61-07c1-4cca-86a1-5c0a33e38eaf tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3878eb61-07c1-4cca-86a1-5c0a33e38eaf tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3878eb61-07c1-4cca-86a1-5c0a33e38eaf tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3878eb61-07c1-4cca-86a1-5c0a33e38eaf tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:10 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-3878eb61-07c1-4cca-86a1-5c0a33e38eaf tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:24:10 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-3878eb61-07c1-4cca-86a1-5c0a33e38eaf tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1722 microversion: 2.1 time: 0.200445 Apr 13 15:24:10 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 236/699] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:24:10 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:24:10 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-d1527c2e-71b4-4823-b3bf-ca7b4e92a9f6 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:24:10 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-d1527c2e-71b4-4823-b3bf-ca7b4e92a9f6 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:24:10 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:24:10 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:24:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d1527c2e-71b4-4823-b3bf-ca7b4e92a9f6 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d1527c2e-71b4-4823-b3bf-ca7b4e92a9f6 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d1527c2e-71b4-4823-b3bf-ca7b4e92a9f6 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d1527c2e-71b4-4823-b3bf-ca7b4e92a9f6 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d1527c2e-71b4-4823-b3bf-ca7b4e92a9f6 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d1527c2e-71b4-4823-b3bf-ca7b4e92a9f6 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:10 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-d1527c2e-71b4-4823-b3bf-ca7b4e92a9f6 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:24:10 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-d1527c2e-71b4-4823-b3bf-ca7b4e92a9f6 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1722 microversion: 2.1 time: 0.183546 Apr 13 15:24:10 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 235/700] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:24:10 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:24:19 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:24:19 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:24:19 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-b00e6762-3284-4662-9bb9-4354944b9ff5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:24:19 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-b00e6762-3284-4662-9bb9-4354944b9ff5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:24:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b00e6762-3284-4662-9bb9-4354944b9ff5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b00e6762-3284-4662-9bb9-4354944b9ff5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b00e6762-3284-4662-9bb9-4354944b9ff5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b00e6762-3284-4662-9bb9-4354944b9ff5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b00e6762-3284-4662-9bb9-4354944b9ff5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b00e6762-3284-4662-9bb9-4354944b9ff5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:19 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-b00e6762-3284-4662-9bb9-4354944b9ff5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] HTTP exception thrown: Instance 25f57234-8818-44d3-b476-d6cfba7b2810 could not be found. Apr 13 15:24:19 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-b00e6762-3284-4662-9bb9-4354944b9ff5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Request method failure captured: Apr 13 15:24:19 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/25f57234-8818-44d3-b476-d6cfba7b2810 HTTP/1.1 Apr 13 15:24:19 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:24:19 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:24:19 user devstack@n-api.service[61871]: Connection: close Apr 13 15:24:19 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:24:19 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:24:19 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:24:19 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:24:19 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:24:19 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBqsGdw3aycWoeNTF5dIwz9M4XoihFvfDydEnbooAOgxqZE-k6qSuH5o67HiM2sVa6RcOyUtIsnkDUaPOUoPWZlOnWwrJAmh2HS8sFequPAvZEFaKGsiH5QLqfUXGyfRHGhNYdseVYaXNX3DzwjC8qCRhoxAP0-nP_gTeqRe2MpQXfI Apr 13 15:24:19 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:24:19 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:24:19 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:24:19 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:24:19 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:24:19 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:24:19 user devstack@n-api.service[61871]: X-Project-Id: 9bad96fcfa0d4691af2a7990ba9dbd09 Apr 13 15:24:19 user devstack@n-api.service[61871]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-66620130 Apr 13 15:24:19 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:24:19 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:24:19 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9bad96fcfa0d4691af2a7990ba9dbd09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bad96fcfa0d4691af2a7990ba9dbd09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bad96fcfa0d4691af2a7990ba9dbd09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:24:19 user devstack@n-api.service[61871]: X-Tenant: tempest-ServerRescueNegativeTestJSON-66620130 Apr 13 15:24:19 user devstack@n-api.service[61871]: X-Tenant-Id: 9bad96fcfa0d4691af2a7990ba9dbd09 Apr 13 15:24:19 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-66620130 Apr 13 15:24:19 user devstack@n-api.service[61871]: X-User: tempest-ServerRescueNegativeTestJSON-66620130-project-member Apr 13 15:24:19 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:24:19 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:24:19 user devstack@n-api.service[61871]: X-User-Id: c83940ddaaf64d94b40df9d00349aa91 Apr 13 15:24:19 user devstack@n-api.service[61871]: X-User-Name: tempest-ServerRescueNegativeTestJSON-66620130-project-member Apr 13 15:24:19 user devstack@n-api.service[61871]: method: > Apr 13 15:24:19 user devstack@n-api.service[61871]: exception: Instance 25f57234-8818-44d3-b476-d6cfba7b2810 could not be found. Apr 13 15:24:19 user devstack@n-api.service[61871]: action_args: {'id': '25f57234-8818-44d3-b476-d6cfba7b2810'} Apr 13 15:24:19 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25f57234-8818-44d3-b476-d6cfba7b2810 could not be found. Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25f57234-8818-44d3-b476-d6cfba7b2810 could not be found. Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25f57234-8818-44d3-b476-d6cfba7b2810 could not be found. Apr 13 15:24:19 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:24:19 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-b00e6762-3284-4662-9bb9-4354944b9ff5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Returning 404 to user: Instance 25f57234-8818-44d3-b476-d6cfba7b2810 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:24:19 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-b00e6762-3284-4662-9bb9-4354944b9ff5 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25f57234-8818-44d3-b476-d6cfba7b2810" status: 404 len: 111 microversion: 2.1 time: 0.135834 Apr 13 15:24:19 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 230/701] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:24:19 2023] GET /compute/v2.1/servers/25f57234-8818-44d3-b476-d6cfba7b2810 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:24:19 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:24:19 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:24:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:19 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Going to try to terminate instance {{(pid=61872) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:24:19 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653" status: 204 len: 0 microversion: 2.1 time: 0.121516 Apr 13 15:24:19 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 237/702] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:24:19 2023] DELETE /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:24:19 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-a3d2b7ce-620d-4b99-a61e-b39a498e4238 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:24:19 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-a3d2b7ce-620d-4b99-a61e-b39a498e4238 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:24:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a3d2b7ce-620d-4b99-a61e-b39a498e4238 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a3d2b7ce-620d-4b99-a61e-b39a498e4238 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a3d2b7ce-620d-4b99-a61e-b39a498e4238 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a3d2b7ce-620d-4b99-a61e-b39a498e4238 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a3d2b7ce-620d-4b99-a61e-b39a498e4238 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a3d2b7ce-620d-4b99-a61e-b39a498e4238 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:20 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-a3d2b7ce-620d-4b99-a61e-b39a498e4238 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:24:20 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-a3d2b7ce-620d-4b99-a61e-b39a498e4238 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653" status: 200 len: 1508 microversion: 2.1 time: 0.837439 Apr 13 15:24:20 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 236/703] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:24:19 2023] GET /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653 => generated 1508 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:24:20 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-efc41e39-bead-44a6-a634-5f13cdba0d3b req-62ab4654-e971-4445-9fca-2225bd3eb256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f54cffe3-73da-468b-8252-b74cb4ba9653", "name": "network-vif-unplugged", "status": "completed", "tag": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:24:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-efc41e39-bead-44a6-a634-5f13cdba0d3b req-62ab4654-e971-4445-9fca-2225bd3eb256 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-efc41e39-bead-44a6-a634-5f13cdba0d3b req-62ab4654-e971-4445-9fca-2225bd3eb256 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-efc41e39-bead-44a6-a634-5f13cdba0d3b req-62ab4654-e971-4445-9fca-2225bd3eb256 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:20 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-efc41e39-bead-44a6-a634-5f13cdba0d3b req-62ab4654-e971-4445-9fca-2225bd3eb256 service nova] Creating event network-vif-unplugged:0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance f54cffe3-73da-468b-8252-b74cb4ba9653 on user Apr 13 15:24:20 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-efc41e39-bead-44a6-a634-5f13cdba0d3b req-62ab4654-e971-4445-9fca-2225bd3eb256 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036874 Apr 13 15:24:20 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 231/704] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:24:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:24:22 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-19826ae9-ea02-48d5-99e1-8e47b0e914da req-e33e4904-b6df-4876-9d61-9e9389c0788b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f54cffe3-73da-468b-8252-b74cb4ba9653", "name": "network-vif-plugged", "status": "completed", "tag": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d"}, {"server_uuid": "f54cffe3-73da-468b-8252-b74cb4ba9653", "name": "network-vif-deleted", "tag": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:24:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-19826ae9-ea02-48d5-99e1-8e47b0e914da req-e33e4904-b6df-4876-9d61-9e9389c0788b service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-19826ae9-ea02-48d5-99e1-8e47b0e914da req-e33e4904-b6df-4876-9d61-9e9389c0788b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-19826ae9-ea02-48d5-99e1-8e47b0e914da req-e33e4904-b6df-4876-9d61-9e9389c0788b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:22 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-19826ae9-ea02-48d5-99e1-8e47b0e914da req-e33e4904-b6df-4876-9d61-9e9389c0788b service nova] Creating event network-vif-plugged:0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance f54cffe3-73da-468b-8252-b74cb4ba9653 on user Apr 13 15:24:22 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-19826ae9-ea02-48d5-99e1-8e47b0e914da req-e33e4904-b6df-4876-9d61-9e9389c0788b service nova] Creating event network-vif-deleted:0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance f54cffe3-73da-468b-8252-b74cb4ba9653 on user Apr 13 15:24:22 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-19826ae9-ea02-48d5-99e1-8e47b0e914da req-e33e4904-b6df-4876-9d61-9e9389c0788b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029532 Apr 13 15:24:22 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 238/705] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:24:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:24:23 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-a24300a7-22fa-481a-bfb1-63b20bc869a8 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:24:23 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-a24300a7-22fa-481a-bfb1-63b20bc869a8 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:24:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a24300a7-22fa-481a-bfb1-63b20bc869a8 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a24300a7-22fa-481a-bfb1-63b20bc869a8 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a24300a7-22fa-481a-bfb1-63b20bc869a8 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a24300a7-22fa-481a-bfb1-63b20bc869a8 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a24300a7-22fa-481a-bfb1-63b20bc869a8 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-a24300a7-22fa-481a-bfb1-63b20bc869a8 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:23 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-a24300a7-22fa-481a-bfb1-63b20bc869a8 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.092047 Apr 13 15:24:23 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 237/706] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 15:24:23 2023] GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e/os-interface => generated 283 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:24:24 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-2aa72392-67aa-4590-a190-47c1f10c429a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:24:24 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-2aa72392-67aa-4590-a190-47c1f10c429a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:24:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2aa72392-67aa-4590-a190-47c1f10c429a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2aa72392-67aa-4590-a190-47c1f10c429a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2aa72392-67aa-4590-a190-47c1f10c429a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2aa72392-67aa-4590-a190-47c1f10c429a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2aa72392-67aa-4590-a190-47c1f10c429a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-2aa72392-67aa-4590-a190-47c1f10c429a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:24 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-2aa72392-67aa-4590-a190-47c1f10c429a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e/ips" status: 200 len: 109 microversion: 2.1 time: 0.039035 Apr 13 15:24:24 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 232/707] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 15:24:24 2023] GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e/ips => generated 109 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:24:24 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-5e9c65c3-023b-4e66-8ad3-2fa9a8112630 req-2a77e768-5bf8-4982-b690-dc4a959f6e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a68333-dc4d-48d9-84c6-4c7cd515853e", "tag": "714a062f-8189-4905-b41f-619554697056"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:24:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-5e9c65c3-023b-4e66-8ad3-2fa9a8112630 req-2a77e768-5bf8-4982-b690-dc4a959f6e6c service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-5e9c65c3-023b-4e66-8ad3-2fa9a8112630 req-2a77e768-5bf8-4982-b690-dc4a959f6e6c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-5e9c65c3-023b-4e66-8ad3-2fa9a8112630 req-2a77e768-5bf8-4982-b690-dc4a959f6e6c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:24 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-5e9c65c3-023b-4e66-8ad3-2fa9a8112630 req-2a77e768-5bf8-4982-b690-dc4a959f6e6c service nova] Creating event network-changed:714a062f-8189-4905-b41f-619554697056 for instance 75a68333-dc4d-48d9-84c6-4c7cd515853e on user Apr 13 15:24:24 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-5e9c65c3-023b-4e66-8ad3-2fa9a8112630 req-2a77e768-5bf8-4982-b690-dc4a959f6e6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035570 Apr 13 15:24:24 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 239/708] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:24:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:24:25 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d95ff23-b0db-4607-a1cb-45efab22658d"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:24:25 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:24:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:25 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "POST /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267746 Apr 13 15:24:25 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 238/709] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:24:25 2023] POST /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:24:33 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c427f560-52c0-41bf-80db-3da5c60523e7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d95ff23-b0db-4607-a1cb-45efab22658d"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:24:33 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-c427f560-52c0-41bf-80db-3da5c60523e7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:24:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c427f560-52c0-41bf-80db-3da5c60523e7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c427f560-52c0-41bf-80db-3da5c60523e7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c427f560-52c0-41bf-80db-3da5c60523e7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c427f560-52c0-41bf-80db-3da5c60523e7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c427f560-52c0-41bf-80db-3da5c60523e7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c427f560-52c0-41bf-80db-3da5c60523e7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:33 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-c427f560-52c0-41bf-80db-3da5c60523e7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] HTTP exception thrown: Invalid volume: volume 2d95ff23-b0db-4607-a1cb-45efab22658d is already attached to instances: 75a68333-dc4d-48d9-84c6-4c7cd515853e Apr 13 15:24:33 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c427f560-52c0-41bf-80db-3da5c60523e7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Request method failure captured: Apr 13 15:24:33 user devstack@n-api.service[61871]: request: POST /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e/os-volume_attachments HTTP/1.1 Apr 13 15:24:33 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:24:33 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:24:33 user devstack@n-api.service[61871]: Connection: close Apr 13 15:24:33 user devstack@n-api.service[61871]: Content-Length: 74 Apr 13 15:24:33 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:24:33 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:24:33 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:24:33 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:24:33 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBysJSC_pL1o3J9cVhCfPJH0RJxZJE2XjaF2Yq1nITqHQPAUJ-sY0C6ehk0hgyb5AGui4kwa-lWhEaqyW-11oCzt4s9SAjj7iiHUYBf3mDz8zQD6VpCcWxM23IvnmM9hydVYLDDtvrzvCJbTCSuVNPu3nJmaP7WJ6HL0s88zCkG70Us Apr 13 15:24:33 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:24:33 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:24:33 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:24:33 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:24:33 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:24:33 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:24:33 user devstack@n-api.service[61871]: X-Project-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:24:33 user devstack@n-api.service[61871]: X-Project-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:24:33 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:24:33 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:24:33 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:24:33 user devstack@n-api.service[61871]: X-Tenant: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:24:33 user devstack@n-api.service[61871]: X-Tenant-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:24:33 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:24:33 user devstack@n-api.service[61871]: X-User: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:24:33 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:24:33 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:24:33 user devstack@n-api.service[61871]: X-User-Id: fedd34ccc15c47f9a4fc96b080730acd Apr 13 15:24:33 user devstack@n-api.service[61871]: X-User-Name: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:24:33 user devstack@n-api.service[61871]: Apr 13 15:24:33 user devstack@n-api.service[61871]: {"volumeAttachment": {"volumeId": "2d95ff23-b0db-4607-a1cb-45efab22658d"}} Apr 13 15:24:33 user devstack@n-api.service[61871]: method: > Apr 13 15:24:33 user devstack@n-api.service[61871]: exception: Invalid volume: volume 2d95ff23-b0db-4607-a1cb-45efab22658d is already attached to instances: 75a68333-dc4d-48d9-84c6-4c7cd515853e Apr 13 15:24:33 user devstack@n-api.service[61871]: action_args: {'server_id': '75a68333-dc4d-48d9-84c6-4c7cd515853e', 'body': {'volumeAttachment': {'volumeId': '2d95ff23-b0db-4607-a1cb-45efab22658d'}}} Apr 13 15:24:33 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2d95ff23-b0db-4607-a1cb-45efab22658d is already attached to instances: 75a68333-dc4d-48d9-84c6-4c7cd515853e Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2d95ff23-b0db-4607-a1cb-45efab22658d is already attached to instances: 75a68333-dc4d-48d9-84c6-4c7cd515853e Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2d95ff23-b0db-4607-a1cb-45efab22658d is already attached to instances: 75a68333-dc4d-48d9-84c6-4c7cd515853e Apr 13 15:24:33 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:24:33 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c427f560-52c0-41bf-80db-3da5c60523e7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Returning 400 to user: Invalid volume: volume 2d95ff23-b0db-4607-a1cb-45efab22658d is already attached to instances: 75a68333-dc4d-48d9-84c6-4c7cd515853e {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:24:33 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-c427f560-52c0-41bf-80db-3da5c60523e7 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "POST /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104737 Apr 13 15:24:33 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 233/710] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:24:33 2023] POST /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:24:33 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:24:33 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:24:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:33 user devstack@n-api.service[61872]: DEBUG nova.objects.instance [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'services' on Instance uuid 75a68333-dc4d-48d9-84c6-4c7cd515853e {{(pid=61872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:24:33 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e/os-volume_attachments/2d95ff23-b0db-4607-a1cb-45efab22658d" status: 202 len: 0 microversion: 2.1 time: 0.159801 Apr 13 15:24:33 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 240/711] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:24:33 2023] DELETE /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e/os-volume_attachments/2d95ff23-b0db-4607-a1cb-45efab22658d => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:24:33 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c2078ac8-1465-4a0a-bdbd-424c918fecea tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:24:33 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-c2078ac8-1465-4a0a-bdbd-424c918fecea tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:24:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c2078ac8-1465-4a0a-bdbd-424c918fecea tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c2078ac8-1465-4a0a-bdbd-424c918fecea tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c2078ac8-1465-4a0a-bdbd-424c918fecea tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c2078ac8-1465-4a0a-bdbd-424c918fecea tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c2078ac8-1465-4a0a-bdbd-424c918fecea tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c2078ac8-1465-4a0a-bdbd-424c918fecea tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:33 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-c2078ac8-1465-4a0a-bdbd-424c918fecea tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047148 Apr 13 15:24:33 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 239/712] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:24:33 2023] GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:24:37 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:24:37 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:24:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:37 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Going to try to terminate instance {{(pid=61871) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:24:37 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f" status: 204 len: 0 microversion: 2.87 time: 0.217485 Apr 13 15:24:37 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 234/713] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 15:24:37 2023] DELETE /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 13 15:24:37 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-24d47f99-bac7-4f58-add9-fac0eedfe104 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:24:37 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-24d47f99-bac7-4f58-add9-fac0eedfe104 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:24:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-24d47f99-bac7-4f58-add9-fac0eedfe104 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-24d47f99-bac7-4f58-add9-fac0eedfe104 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-24d47f99-bac7-4f58-add9-fac0eedfe104 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-24d47f99-bac7-4f58-add9-fac0eedfe104 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-24d47f99-bac7-4f58-add9-fac0eedfe104 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-24d47f99-bac7-4f58-add9-fac0eedfe104 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:37 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-24d47f99-bac7-4f58-add9-fac0eedfe104 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:24:37 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-24d47f99-bac7-4f58-add9-fac0eedfe104 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:24:37 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-24d47f99-bac7-4f58-add9-fac0eedfe104 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:24:37 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-24d47f99-bac7-4f58-add9-fac0eedfe104 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f" status: 200 len: 1773 microversion: 2.87 time: 0.172085 Apr 13 15:24:37 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 241/714] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:24:37 2023] GET /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f => generated 1773 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:24:37 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-66ad0c3e-e57e-42e4-a45e-c84f4620792e req-50aef839-f7c7-4e6f-94e5-a8a838214b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c609c1d1-edcf-4b71-abea-5dd95ebcd81f", "name": "network-vif-unplugged", "status": "completed", "tag": "92d492eb-f3b6-4481-b492-949cf7eabd1a"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:24:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-66ad0c3e-e57e-42e4-a45e-c84f4620792e req-50aef839-f7c7-4e6f-94e5-a8a838214b65 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-66ad0c3e-e57e-42e4-a45e-c84f4620792e req-50aef839-f7c7-4e6f-94e5-a8a838214b65 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-66ad0c3e-e57e-42e4-a45e-c84f4620792e req-50aef839-f7c7-4e6f-94e5-a8a838214b65 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:37 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-66ad0c3e-e57e-42e4-a45e-c84f4620792e req-50aef839-f7c7-4e6f-94e5-a8a838214b65 service nova] Creating event network-vif-unplugged:92d492eb-f3b6-4481-b492-949cf7eabd1a for instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f on user Apr 13 15:24:37 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-66ad0c3e-e57e-42e4-a45e-c84f4620792e req-50aef839-f7c7-4e6f-94e5-a8a838214b65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030663 Apr 13 15:24:37 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 240/715] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:24:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:24:39 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-1d64d695-a577-4dc2-8385-5ff0d579cc24 req-6fbf5be6-356f-414b-8a5c-f22eecf68721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c609c1d1-edcf-4b71-abea-5dd95ebcd81f", "name": "network-vif-deleted", "tag": "92d492eb-f3b6-4481-b492-949cf7eabd1a"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:24:39 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-1d64d695-a577-4dc2-8385-5ff0d579cc24 req-6fbf5be6-356f-414b-8a5c-f22eecf68721 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:39 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-1d64d695-a577-4dc2-8385-5ff0d579cc24 req-6fbf5be6-356f-414b-8a5c-f22eecf68721 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:39 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-1d64d695-a577-4dc2-8385-5ff0d579cc24 req-6fbf5be6-356f-414b-8a5c-f22eecf68721 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:39 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-1d64d695-a577-4dc2-8385-5ff0d579cc24 req-6fbf5be6-356f-414b-8a5c-f22eecf68721 service nova] Creating event network-vif-deleted:92d492eb-f3b6-4481-b492-949cf7eabd1a for instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f on user Apr 13 15:24:39 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-1d64d695-a577-4dc2-8385-5ff0d579cc24 req-6fbf5be6-356f-414b-8a5c-f22eecf68721 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088809 Apr 13 15:24:39 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 235/716] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:24:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:24:39 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-6d963353-ed77-48e0-baad-ec4a979230c1 req-fa9b3a5c-5235-42b0-9119-2c42f7fb92ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c609c1d1-edcf-4b71-abea-5dd95ebcd81f", "name": "network-vif-plugged", "status": "completed", "tag": "92d492eb-f3b6-4481-b492-949cf7eabd1a"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:24:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-6d963353-ed77-48e0-baad-ec4a979230c1 req-fa9b3a5c-5235-42b0-9119-2c42f7fb92ca service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-6d963353-ed77-48e0-baad-ec4a979230c1 req-fa9b3a5c-5235-42b0-9119-2c42f7fb92ca service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-6d963353-ed77-48e0-baad-ec4a979230c1 req-fa9b3a5c-5235-42b0-9119-2c42f7fb92ca service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:39 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-6d963353-ed77-48e0-baad-ec4a979230c1 req-fa9b3a5c-5235-42b0-9119-2c42f7fb92ca service nova] Creating event network-vif-plugged:92d492eb-f3b6-4481-b492-949cf7eabd1a for instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f on user Apr 13 15:24:39 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-6d963353-ed77-48e0-baad-ec4a979230c1 req-fa9b3a5c-5235-42b0-9119-2c42f7fb92ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028087 Apr 13 15:24:39 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 242/717] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:24:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:24:55 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=12 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:24:55 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:24:55 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-b3980501-d9ac-4c5b-b0f8-821f3e93904c tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:24:55 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-b3980501-d9ac-4c5b-b0f8-821f3e93904c tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:24:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b3980501-d9ac-4c5b-b0f8-821f3e93904c tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b3980501-d9ac-4c5b-b0f8-821f3e93904c tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b3980501-d9ac-4c5b-b0f8-821f3e93904c tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b3980501-d9ac-4c5b-b0f8-821f3e93904c tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b3980501-d9ac-4c5b-b0f8-821f3e93904c tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b3980501-d9ac-4c5b-b0f8-821f3e93904c tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:55 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-b3980501-d9ac-4c5b-b0f8-821f3e93904c tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.091381 Apr 13 15:24:55 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 241/718] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 15:24:54 2023] GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-interface => generated 282 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:24:55 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:24:55 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:24:55 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-db9bad07-93f6-4810-a7c1-0c8b9649f343 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:24:55 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-db9bad07-93f6-4810-a7c1-0c8b9649f343 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:24:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-db9bad07-93f6-4810-a7c1-0c8b9649f343 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-db9bad07-93f6-4810-a7c1-0c8b9649f343 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-db9bad07-93f6-4810-a7c1-0c8b9649f343 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-db9bad07-93f6-4810-a7c1-0c8b9649f343 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-db9bad07-93f6-4810-a7c1-0c8b9649f343 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-db9bad07-93f6-4810-a7c1-0c8b9649f343 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:55 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-db9bad07-93f6-4810-a7c1-0c8b9649f343 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e289648c244c77ab9ca48154da3cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318b9e0eb6a745df811d1daa4d6195fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:24:55 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-db9bad07-93f6-4810-a7c1-0c8b9649f343 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95" status: 200 len: 1537 microversion: 2.1 time: 0.203030 Apr 13 15:24:55 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 236/719] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:24:55 2023] GET /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95 => generated 1537 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:24:55 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:24:55 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:24:55 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-64dbde39-1906-48b8-aff2-d507738d457a req-7dffd018-2277-4b3a-ae4d-73fbec6da663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f093cc8b-83cd-4154-8b4e-a98481e2c42a", "tag": "1ef64389-9092-411b-a2cf-f0ad923650c5"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:24:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-64dbde39-1906-48b8-aff2-d507738d457a req-7dffd018-2277-4b3a-ae4d-73fbec6da663 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-64dbde39-1906-48b8-aff2-d507738d457a req-7dffd018-2277-4b3a-ae4d-73fbec6da663 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-64dbde39-1906-48b8-aff2-d507738d457a req-7dffd018-2277-4b3a-ae4d-73fbec6da663 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:55 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-64dbde39-1906-48b8-aff2-d507738d457a req-7dffd018-2277-4b3a-ae4d-73fbec6da663 service nova] Creating event network-changed:1ef64389-9092-411b-a2cf-f0ad923650c5 for instance f093cc8b-83cd-4154-8b4e-a98481e2c42a on user Apr 13 15:24:55 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-64dbde39-1906-48b8-aff2-d507738d457a req-7dffd018-2277-4b3a-ae4d-73fbec6da663 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037651 Apr 13 15:24:55 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 243/720] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:24:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:24:55 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-00ef5cfb-dcaf-41a1-9aaf-93e6d53ffdcc tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:24:55 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-00ef5cfb-dcaf-41a1-9aaf-93e6d53ffdcc tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:24:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-00ef5cfb-dcaf-41a1-9aaf-93e6d53ffdcc tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-00ef5cfb-dcaf-41a1-9aaf-93e6d53ffdcc tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-00ef5cfb-dcaf-41a1-9aaf-93e6d53ffdcc tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-00ef5cfb-dcaf-41a1-9aaf-93e6d53ffdcc tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-00ef5cfb-dcaf-41a1-9aaf-93e6d53ffdcc tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-00ef5cfb-dcaf-41a1-9aaf-93e6d53ffdcc tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:55 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-00ef5cfb-dcaf-41a1-9aaf-93e6d53ffdcc tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/ips" status: 200 len: 104 microversion: 2.1 time: 0.035148 Apr 13 15:24:55 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 242/721] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 15:24:55 2023] GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/ips => generated 104 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:24:56 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-4ee395df-4907-4444-9bdf-c6b631b1ccbf req-1e090cc2-7a47-4a59-82af-57175dcb674f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42464137-e247-4191-8ed4-4bbdbe392f95", "tag": "2fcc3406-d672-49a1-85b8-5f2ce187b541"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:24:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-4ee395df-4907-4444-9bdf-c6b631b1ccbf req-1e090cc2-7a47-4a59-82af-57175dcb674f service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-4ee395df-4907-4444-9bdf-c6b631b1ccbf req-1e090cc2-7a47-4a59-82af-57175dcb674f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-4ee395df-4907-4444-9bdf-c6b631b1ccbf req-1e090cc2-7a47-4a59-82af-57175dcb674f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:56 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-4ee395df-4907-4444-9bdf-c6b631b1ccbf req-1e090cc2-7a47-4a59-82af-57175dcb674f service nova] Creating event network-changed:2fcc3406-d672-49a1-85b8-5f2ce187b541 for instance 42464137-e247-4191-8ed4-4bbdbe392f95 on user Apr 13 15:24:56 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-4ee395df-4907-4444-9bdf-c6b631b1ccbf req-1e090cc2-7a47-4a59-82af-57175dcb674f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033653 Apr 13 15:24:56 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 237/722] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:24:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:24:56 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ab95335-13ea-472f-8b96-919fb6f2cc1e"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:24:56 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:24:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:57 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "POST /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271893 Apr 13 15:24:57 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 244/723] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:24:56 2023] POST /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:24:57 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5bcc099-e571-44a4-96ed-33e4c3a0bd73"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:24:57 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:24:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:24:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:24:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:24:57 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.655865 Apr 13 15:24:57 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 243/724] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:24:57 2023] POST /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments => generated 194 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-6b89abb5-0b6b-4f9e-93ad-bd7015d9e54a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:05 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-6b89abb5-0b6b-4f9e-93ad-bd7015d9e54a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:05 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6b89abb5-0b6b-4f9e-93ad-bd7015d9e54a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:05 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6b89abb5-0b6b-4f9e-93ad-bd7015d9e54a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:05 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6b89abb5-0b6b-4f9e-93ad-bd7015d9e54a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:05 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6b89abb5-0b6b-4f9e-93ad-bd7015d9e54a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:05 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6b89abb5-0b6b-4f9e-93ad-bd7015d9e54a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:05 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6b89abb5-0b6b-4f9e-93ad-bd7015d9e54a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:05 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-6b89abb5-0b6b-4f9e-93ad-bd7015d9e54a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055349 Apr 13 15:25:05 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 238/725] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:25:05 2023] GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-b24a362c-ca55-4019-8c10-c6c24d108de6 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:05 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-b24a362c-ca55-4019-8c10-c6c24d108de6 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b24a362c-ca55-4019-8c10-c6c24d108de6 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b24a362c-ca55-4019-8c10-c6c24d108de6 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b24a362c-ca55-4019-8c10-c6c24d108de6 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b24a362c-ca55-4019-8c10-c6c24d108de6 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b24a362c-ca55-4019-8c10-c6c24d108de6 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b24a362c-ca55-4019-8c10-c6c24d108de6 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:05 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-b24a362c-ca55-4019-8c10-c6c24d108de6 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments/e5bcc099-e571-44a4-96ed-33e4c3a0bd73" status: 200 len: 194 microversion: 2.1 time: 0.046077 Apr 13 15:25:05 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 245/726] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 15:25:05 2023] GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments/e5bcc099-e571-44a4-96ed-33e4c3a0bd73 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:05 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:06 user devstack@n-api.service[61873]: DEBUG nova.objects.instance [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lazy-loading 'services' on Instance uuid 42464137-e247-4191-8ed4-4bbdbe392f95 {{(pid=61873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:25:06 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95/os-volume_attachments/8ab95335-13ea-472f-8b96-919fb6f2cc1e" status: 202 len: 0 microversion: 2.1 time: 0.177681 Apr 13 15:25:06 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 244/727] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:25:05 2023] DELETE /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95/os-volume_attachments/8ab95335-13ea-472f-8b96-919fb6f2cc1e => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:25:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-a29f28ef-79b6-4cc9-96fc-9f74a870d2a6 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:06 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-a29f28ef-79b6-4cc9-96fc-9f74a870d2a6 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a29f28ef-79b6-4cc9-96fc-9f74a870d2a6 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a29f28ef-79b6-4cc9-96fc-9f74a870d2a6 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a29f28ef-79b6-4cc9-96fc-9f74a870d2a6 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a29f28ef-79b6-4cc9-96fc-9f74a870d2a6 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a29f28ef-79b6-4cc9-96fc-9f74a870d2a6 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a29f28ef-79b6-4cc9-96fc-9f74a870d2a6 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:06 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-a29f28ef-79b6-4cc9-96fc-9f74a870d2a6 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055124 Apr 13 15:25:06 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 239/728] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:25:06 2023] GET /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:07 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edabdca8-0695-4bae-b177-b99c7144961d"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:25:07 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:07 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325992 Apr 13 15:25:07 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 246/729] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:25:07 2023] POST /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:10 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c4ac1951-37da-439f-a7a9-7c9d5caaaa04 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:10 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-c4ac1951-37da-439f-a7a9-7c9d5caaaa04 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c4ac1951-37da-439f-a7a9-7c9d5caaaa04 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c4ac1951-37da-439f-a7a9-7c9d5caaaa04 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c4ac1951-37da-439f-a7a9-7c9d5caaaa04 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c4ac1951-37da-439f-a7a9-7c9d5caaaa04 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c4ac1951-37da-439f-a7a9-7c9d5caaaa04 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c4ac1951-37da-439f-a7a9-7c9d5caaaa04 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:10 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-c4ac1951-37da-439f-a7a9-7c9d5caaaa04 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] HTTP exception thrown: Instance f54cffe3-73da-468b-8252-b74cb4ba9653 could not be found. Apr 13 15:25:10 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c4ac1951-37da-439f-a7a9-7c9d5caaaa04 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Request method failure captured: Apr 13 15:25:10 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653 HTTP/1.1 Apr 13 15:25:10 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:25:10 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:25:10 user devstack@n-api.service[61873]: Connection: close Apr 13 15:25:10 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:25:10 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:25:10 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:25:10 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:25:10 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:25:10 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBqsGdw3aycWoeNTF5dIwz9M4XoihFvfDydEnbooAOgxqZE-k6qSuH5o67HiM2sVa6RcOyUtIsnkDUaPOUoPWZlOnWwrJAmh2HS8sFequPAvZEFaKGsiH5QLqfUXGyfRHGhNYdseVYaXNX3DzwjC8qCRhoxAP0-nP_gTeqRe2MpQXfI Apr 13 15:25:10 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:25:10 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:25:10 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:25:10 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:25:10 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:25:10 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:25:10 user devstack@n-api.service[61873]: X-Project-Id: 9bad96fcfa0d4691af2a7990ba9dbd09 Apr 13 15:25:10 user devstack@n-api.service[61873]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-66620130 Apr 13 15:25:10 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:25:10 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:25:10 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9bad96fcfa0d4691af2a7990ba9dbd09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bad96fcfa0d4691af2a7990ba9dbd09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bad96fcfa0d4691af2a7990ba9dbd09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:25:10 user devstack@n-api.service[61873]: X-Tenant: tempest-ServerRescueNegativeTestJSON-66620130 Apr 13 15:25:10 user devstack@n-api.service[61873]: X-Tenant-Id: 9bad96fcfa0d4691af2a7990ba9dbd09 Apr 13 15:25:10 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-66620130 Apr 13 15:25:10 user devstack@n-api.service[61873]: X-User: tempest-ServerRescueNegativeTestJSON-66620130-project-member Apr 13 15:25:10 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:25:10 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:25:10 user devstack@n-api.service[61873]: X-User-Id: c83940ddaaf64d94b40df9d00349aa91 Apr 13 15:25:10 user devstack@n-api.service[61873]: X-User-Name: tempest-ServerRescueNegativeTestJSON-66620130-project-member Apr 13 15:25:10 user devstack@n-api.service[61873]: method: > Apr 13 15:25:10 user devstack@n-api.service[61873]: exception: Instance f54cffe3-73da-468b-8252-b74cb4ba9653 could not be found. Apr 13 15:25:10 user devstack@n-api.service[61873]: action_args: {'id': 'f54cffe3-73da-468b-8252-b74cb4ba9653'} Apr 13 15:25:10 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f54cffe3-73da-468b-8252-b74cb4ba9653 could not be found. Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f54cffe3-73da-468b-8252-b74cb4ba9653 could not be found. Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f54cffe3-73da-468b-8252-b74cb4ba9653 could not be found. Apr 13 15:25:10 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:25:10 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c4ac1951-37da-439f-a7a9-7c9d5caaaa04 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Returning 404 to user: Instance f54cffe3-73da-468b-8252-b74cb4ba9653 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:25:10 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-c4ac1951-37da-439f-a7a9-7c9d5caaaa04 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653" status: 404 len: 111 microversion: 2.1 time: 0.031704 Apr 13 15:25:10 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 245/730] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:25:10 2023] GET /compute/v2.1/servers/f54cffe3-73da-468b-8252-b74cb4ba9653 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:25:10 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:10 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:10 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Going to try to terminate instance {{(pid=61871) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:25:11 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 204 len: 0 microversion: 2.1 time: 0.117802 Apr 13 15:25:11 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 240/731] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:25:10 2023] DELETE /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:25:11 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-deb6eb01-06f2-4880-9d9d-40f66647cf1c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:11 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-deb6eb01-06f2-4880-9d9d-40f66647cf1c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-deb6eb01-06f2-4880-9d9d-40f66647cf1c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-deb6eb01-06f2-4880-9d9d-40f66647cf1c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-deb6eb01-06f2-4880-9d9d-40f66647cf1c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-deb6eb01-06f2-4880-9d9d-40f66647cf1c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-deb6eb01-06f2-4880-9d9d-40f66647cf1c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-deb6eb01-06f2-4880-9d9d-40f66647cf1c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:11 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-deb6eb01-06f2-4880-9d9d-40f66647cf1c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:25:11 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-deb6eb01-06f2-4880-9d9d-40f66647cf1c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 200 len: 1728 microversion: 2.1 time: 0.300050 Apr 13 15:25:11 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 247/732] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:25:11 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 1728 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:25:11 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-bf063152-ac2a-4152-bd49-3dfcc8978ad5 req-695dc975-e1d5-4906-a2b3-2e3e6273c46f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b5bd-5f78-448e-bd82-74b2263dff75", "name": "network-vif-unplugged", "status": "completed", "tag": "9c8ad360-aa62-4ef1-952f-d73f885baa89"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:25:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-bf063152-ac2a-4152-bd49-3dfcc8978ad5 req-695dc975-e1d5-4906-a2b3-2e3e6273c46f service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-bf063152-ac2a-4152-bd49-3dfcc8978ad5 req-695dc975-e1d5-4906-a2b3-2e3e6273c46f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-bf063152-ac2a-4152-bd49-3dfcc8978ad5 req-695dc975-e1d5-4906-a2b3-2e3e6273c46f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:11 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-bf063152-ac2a-4152-bd49-3dfcc8978ad5 req-695dc975-e1d5-4906-a2b3-2e3e6273c46f service nova] Creating event network-vif-unplugged:9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 on user Apr 13 15:25:11 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-bf063152-ac2a-4152-bd49-3dfcc8978ad5 req-695dc975-e1d5-4906-a2b3-2e3e6273c46f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060022 Apr 13 15:25:11 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 246/733] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:25:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:13 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-8caa8c6e-fb33-470c-840c-09601e5c0e23 req-52aab2c3-b5b0-4e94-8974-fa910ff280a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b5bd-5f78-448e-bd82-74b2263dff75", "name": "network-vif-plugged", "status": "completed", "tag": "9c8ad360-aa62-4ef1-952f-d73f885baa89"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:25:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-8caa8c6e-fb33-470c-840c-09601e5c0e23 req-52aab2c3-b5b0-4e94-8974-fa910ff280a4 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-8caa8c6e-fb33-470c-840c-09601e5c0e23 req-52aab2c3-b5b0-4e94-8974-fa910ff280a4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-8caa8c6e-fb33-470c-840c-09601e5c0e23 req-52aab2c3-b5b0-4e94-8974-fa910ff280a4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:13 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-8caa8c6e-fb33-470c-840c-09601e5c0e23 req-52aab2c3-b5b0-4e94-8974-fa910ff280a4 service nova] Creating event network-vif-plugged:9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 on user Apr 13 15:25:13 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-8caa8c6e-fb33-470c-840c-09601e5c0e23 req-52aab2c3-b5b0-4e94-8974-fa910ff280a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040808 Apr 13 15:25:13 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 241/734] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:25:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:14 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-bee92484-690e-42fe-ab5f-2a4c816dc004 req-b005e93b-6121-4072-bf6f-7aa26cd21b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b5bd-5f78-448e-bd82-74b2263dff75", "name": "network-vif-deleted", "tag": "9c8ad360-aa62-4ef1-952f-d73f885baa89"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:25:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-bee92484-690e-42fe-ab5f-2a4c816dc004 req-b005e93b-6121-4072-bf6f-7aa26cd21b10 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-bee92484-690e-42fe-ab5f-2a4c816dc004 req-b005e93b-6121-4072-bf6f-7aa26cd21b10 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-bee92484-690e-42fe-ab5f-2a4c816dc004 req-b005e93b-6121-4072-bf6f-7aa26cd21b10 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:14 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-bee92484-690e-42fe-ab5f-2a4c816dc004 req-b005e93b-6121-4072-bf6f-7aa26cd21b10 service nova] Creating event network-vif-deleted:9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 on user Apr 13 15:25:14 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-bee92484-690e-42fe-ab5f-2a4c816dc004 req-b005e93b-6121-4072-bf6f-7aa26cd21b10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035475 Apr 13 15:25:14 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 248/735] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:25:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:14 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-28f75872-22d3-4352-af81-3db313ea69ca tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:14 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-28f75872-22d3-4352-af81-3db313ea69ca tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:14 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-28f75872-22d3-4352-af81-3db313ea69ca tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:14 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-28f75872-22d3-4352-af81-3db313ea69ca tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:14 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-28f75872-22d3-4352-af81-3db313ea69ca tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:14 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-28f75872-22d3-4352-af81-3db313ea69ca tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:14 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-28f75872-22d3-4352-af81-3db313ea69ca tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:14 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-28f75872-22d3-4352-af81-3db313ea69ca tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:14 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-28f75872-22d3-4352-af81-3db313ea69ca tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046622 Apr 13 15:25:14 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 247/736] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:25:14 2023] GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:15 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-354af2f1-a3c0-44e9-a49c-b220936dd792 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:15 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-354af2f1-a3c0-44e9-a49c-b220936dd792 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-354af2f1-a3c0-44e9-a49c-b220936dd792 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-354af2f1-a3c0-44e9-a49c-b220936dd792 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-354af2f1-a3c0-44e9-a49c-b220936dd792 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-354af2f1-a3c0-44e9-a49c-b220936dd792 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-354af2f1-a3c0-44e9-a49c-b220936dd792 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-354af2f1-a3c0-44e9-a49c-b220936dd792 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:15 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-354af2f1-a3c0-44e9-a49c-b220936dd792 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments/e5bcc099-e571-44a4-96ed-33e4c3a0bd73" status: 200 len: 194 microversion: 2.1 time: 0.046142 Apr 13 15:25:15 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 242/737] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 15:25:15 2023] GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments/e5bcc099-e571-44a4-96ed-33e4c3a0bd73 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:15 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:15 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:15 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:15 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:15 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:15 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:15 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:15 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:15 user devstack@n-api.service[61872]: DEBUG nova.objects.instance [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'services' on Instance uuid f093cc8b-83cd-4154-8b4e-a98481e2c42a {{(pid=61872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:25:15 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments/e5bcc099-e571-44a4-96ed-33e4c3a0bd73" status: 202 len: 0 microversion: 2.1 time: 0.177431 Apr 13 15:25:15 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 249/738] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:25:15 2023] DELETE /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments/e5bcc099-e571-44a4-96ed-33e4c3a0bd73 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:25:17 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-5296fb0c-e6cd-4845-ac12-967b332b07e7 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:17 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-5296fb0c-e6cd-4845-ac12-967b332b07e7 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5296fb0c-e6cd-4845-ac12-967b332b07e7 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5296fb0c-e6cd-4845-ac12-967b332b07e7 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5296fb0c-e6cd-4845-ac12-967b332b07e7 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5296fb0c-e6cd-4845-ac12-967b332b07e7 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5296fb0c-e6cd-4845-ac12-967b332b07e7 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5296fb0c-e6cd-4845-ac12-967b332b07e7 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:17 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-5296fb0c-e6cd-4845-ac12-967b332b07e7 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments/edabdca8-0695-4bae-b177-b99c7144961d" status: 200 len: 194 microversion: 2.1 time: 0.046739 Apr 13 15:25:17 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 248/739] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 15:25:17 2023] GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments/edabdca8-0695-4bae-b177-b99c7144961d => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:17 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:17 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:17 user devstack@n-api.service[61871]: DEBUG nova.objects.instance [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'services' on Instance uuid f093cc8b-83cd-4154-8b4e-a98481e2c42a {{(pid=61871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:25:17 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments/edabdca8-0695-4bae-b177-b99c7144961d" status: 202 len: 0 microversion: 2.1 time: 0.165980 Apr 13 15:25:17 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 243/740] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:25:17 2023] DELETE /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments/edabdca8-0695-4bae-b177-b99c7144961d => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:25:19 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e8d20049-aaf5-4c7a-9cfe-359cb563da62 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:19 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-e8d20049-aaf5-4c7a-9cfe-359cb563da62 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e8d20049-aaf5-4c7a-9cfe-359cb563da62 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e8d20049-aaf5-4c7a-9cfe-359cb563da62 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e8d20049-aaf5-4c7a-9cfe-359cb563da62 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e8d20049-aaf5-4c7a-9cfe-359cb563da62 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e8d20049-aaf5-4c7a-9cfe-359cb563da62 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e8d20049-aaf5-4c7a-9cfe-359cb563da62 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:19 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-e8d20049-aaf5-4c7a-9cfe-359cb563da62 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050692 Apr 13 15:25:19 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 250/741] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:25:19 2023] GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:25:20 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-79da3474-0b2d-4a1c-ac69-ebe04c3d9599 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:20 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-79da3474-0b2d-4a1c-ac69-ebe04c3d9599 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-79da3474-0b2d-4a1c-ac69-ebe04c3d9599 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-79da3474-0b2d-4a1c-ac69-ebe04c3d9599 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-79da3474-0b2d-4a1c-ac69-ebe04c3d9599 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-79da3474-0b2d-4a1c-ac69-ebe04c3d9599 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-79da3474-0b2d-4a1c-ac69-ebe04c3d9599 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-79da3474-0b2d-4a1c-ac69-ebe04c3d9599 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:20 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-79da3474-0b2d-4a1c-ac69-ebe04c3d9599 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044177 Apr 13 15:25:20 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 249/742] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:25:20 2023] GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:25:20 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:20 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:20 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Going to try to terminate instance {{(pid=61871) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:25:20 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a" status: 204 len: 0 microversion: 2.1 time: 0.116211 Apr 13 15:25:20 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 244/743] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:25:20 2023] DELETE /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:25:20 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-83d745cf-4f4c-42e4-8dfc-1a7307db6cf4 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:20 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-83d745cf-4f4c-42e4-8dfc-1a7307db6cf4 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-83d745cf-4f4c-42e4-8dfc-1a7307db6cf4 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-83d745cf-4f4c-42e4-8dfc-1a7307db6cf4 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-83d745cf-4f4c-42e4-8dfc-1a7307db6cf4 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-83d745cf-4f4c-42e4-8dfc-1a7307db6cf4 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-83d745cf-4f4c-42e4-8dfc-1a7307db6cf4 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:20 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-83d745cf-4f4c-42e4-8dfc-1a7307db6cf4 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:20 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-ce9b2eb4-5e7b-4c86-b8eb-0efb85e852eb req-a2520e5b-e6d0-4894-ab7c-b7c746b0d3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f093cc8b-83cd-4154-8b4e-a98481e2c42a", "name": "network-vif-unplugged", "status": "completed", "tag": "1ef64389-9092-411b-a2cf-f0ad923650c5"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:25:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-ce9b2eb4-5e7b-4c86-b8eb-0efb85e852eb req-a2520e5b-e6d0-4894-ab7c-b7c746b0d3b3 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-ce9b2eb4-5e7b-4c86-b8eb-0efb85e852eb req-a2520e5b-e6d0-4894-ab7c-b7c746b0d3b3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-ce9b2eb4-5e7b-4c86-b8eb-0efb85e852eb req-a2520e5b-e6d0-4894-ab7c-b7c746b0d3b3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:20 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-ce9b2eb4-5e7b-4c86-b8eb-0efb85e852eb req-a2520e5b-e6d0-4894-ab7c-b7c746b0d3b3 service nova] Creating event network-vif-unplugged:1ef64389-9092-411b-a2cf-f0ad923650c5 for instance f093cc8b-83cd-4154-8b4e-a98481e2c42a on user Apr 13 15:25:20 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-ce9b2eb4-5e7b-4c86-b8eb-0efb85e852eb req-a2520e5b-e6d0-4894-ab7c-b7c746b0d3b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031277 Apr 13 15:25:20 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 250/744] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:25:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:20 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-83d745cf-4f4c-42e4-8dfc-1a7307db6cf4 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1a698b103a47c0b2864eef54be648b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceba33821a9b4f7aa81c2857c11261f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:25:20 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-83d745cf-4f4c-42e4-8dfc-1a7307db6cf4 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a" status: 200 len: 1662 microversion: 2.1 time: 0.261440 Apr 13 15:25:20 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 251/745] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:25:20 2023] GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a => generated 1662 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:25:22 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-a53da693-8799-43b5-9219-f0dcba8db038 req-9529362f-7c19-486d-9e2e-a1aa219cebbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f093cc8b-83cd-4154-8b4e-a98481e2c42a", "name": "network-vif-deleted", "tag": "1ef64389-9092-411b-a2cf-f0ad923650c5"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:25:22 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a53da693-8799-43b5-9219-f0dcba8db038 req-9529362f-7c19-486d-9e2e-a1aa219cebbe service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:22 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a53da693-8799-43b5-9219-f0dcba8db038 req-9529362f-7c19-486d-9e2e-a1aa219cebbe service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:22 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a53da693-8799-43b5-9219-f0dcba8db038 req-9529362f-7c19-486d-9e2e-a1aa219cebbe service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:22 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-a53da693-8799-43b5-9219-f0dcba8db038 req-9529362f-7c19-486d-9e2e-a1aa219cebbe service nova] Creating event network-vif-deleted:1ef64389-9092-411b-a2cf-f0ad923650c5 for instance f093cc8b-83cd-4154-8b4e-a98481e2c42a on user Apr 13 15:25:22 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-a53da693-8799-43b5-9219-f0dcba8db038 req-9529362f-7c19-486d-9e2e-a1aa219cebbe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032807 Apr 13 15:25:22 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 245/746] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:25:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:22 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f093cc8b-83cd-4154-8b4e-a98481e2c42a", "name": "network-vif-plugged", "status": "completed", "tag": "1ef64389-9092-411b-a2cf-f0ad923650c5"}, {"server_uuid": "f093cc8b-83cd-4154-8b4e-a98481e2c42a", "name": "network-vif-plugged", "status": "completed", "tag": "1ef64389-9092-411b-a2cf-f0ad923650c5"}, {"server_uuid": "f093cc8b-83cd-4154-8b4e-a98481e2c42a", "name": "network-vif-plugged", "status": "completed", "tag": "1ef64389-9092-411b-a2cf-f0ad923650c5"}, {"server_uuid": "f093cc8b-83cd-4154-8b4e-a98481e2c42a", "name": "network-vif-unplugged", "status": "completed", "tag": "1ef64389-9092-411b-a2cf-f0ad923650c5"}, {"server_uuid": "f093cc8b-83cd-4154-8b4e-a98481e2c42a", "name": "network-vif-plugged", "status": "completed", "tag": "1ef64389-9092-411b-a2cf-f0ad923650c5"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:25:22 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:22 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:22 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:22 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Creating event network-vif-plugged:1ef64389-9092-411b-a2cf-f0ad923650c5 for instance f093cc8b-83cd-4154-8b4e-a98481e2c42a on user Apr 13 15:25:22 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Creating event network-vif-plugged:1ef64389-9092-411b-a2cf-f0ad923650c5 for instance f093cc8b-83cd-4154-8b4e-a98481e2c42a on user Apr 13 15:25:22 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Creating event network-vif-plugged:1ef64389-9092-411b-a2cf-f0ad923650c5 for instance f093cc8b-83cd-4154-8b4e-a98481e2c42a on user Apr 13 15:25:22 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Creating event network-vif-unplugged:1ef64389-9092-411b-a2cf-f0ad923650c5 for instance f093cc8b-83cd-4154-8b4e-a98481e2c42a on user Apr 13 15:25:22 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Creating event network-vif-plugged:1ef64389-9092-411b-a2cf-f0ad923650c5 for instance f093cc8b-83cd-4154-8b4e-a98481e2c42a on user Apr 13 15:25:22 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.030755 Apr 13 15:25:22 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 251/747] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:25:22 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:23 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-ed5a43e5-c1ae-402b-8711-d744b84ec5e1 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:23 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-ed5a43e5-c1ae-402b-8711-d744b84ec5e1 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ed5a43e5-c1ae-402b-8711-d744b84ec5e1 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ed5a43e5-c1ae-402b-8711-d744b84ec5e1 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ed5a43e5-c1ae-402b-8711-d744b84ec5e1 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ed5a43e5-c1ae-402b-8711-d744b84ec5e1 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ed5a43e5-c1ae-402b-8711-d744b84ec5e1 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ed5a43e5-c1ae-402b-8711-d744b84ec5e1 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:23 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-ed5a43e5-c1ae-402b-8711-d744b84ec5e1 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.038892 Apr 13 15:25:23 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 252/748] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:25:23 2023] GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e/os-volume_attachments => generated 25 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 13 15:25:24 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:24 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:24 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Going to try to terminate instance {{(pid=61871) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:25:24 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e" status: 204 len: 0 microversion: 2.1 time: 0.128110 Apr 13 15:25:24 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 246/749] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:25:24 2023] DELETE /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:25:24 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-9b9178b6-2bec-4633-b61c-08a1d0fda44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:24 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-9b9178b6-2bec-4633-b61c-08a1d0fda44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:24 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9b9178b6-2bec-4633-b61c-08a1d0fda44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:24 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9b9178b6-2bec-4633-b61c-08a1d0fda44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:24 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9b9178b6-2bec-4633-b61c-08a1d0fda44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:24 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9b9178b6-2bec-4633-b61c-08a1d0fda44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:24 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9b9178b6-2bec-4633-b61c-08a1d0fda44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:24 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9b9178b6-2bec-4633-b61c-08a1d0fda44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:24 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-aca895f0-8bc2-4c30-b451-4be25cf1a137 req-0c080d83-4b1c-4c71-8264-c4e8dc234cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a68333-dc4d-48d9-84c6-4c7cd515853e", "name": "network-vif-unplugged", "status": "completed", "tag": "714a062f-8189-4905-b41f-619554697056"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:25:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-aca895f0-8bc2-4c30-b451-4be25cf1a137 req-0c080d83-4b1c-4c71-8264-c4e8dc234cb2 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-aca895f0-8bc2-4c30-b451-4be25cf1a137 req-0c080d83-4b1c-4c71-8264-c4e8dc234cb2 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-aca895f0-8bc2-4c30-b451-4be25cf1a137 req-0c080d83-4b1c-4c71-8264-c4e8dc234cb2 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:24 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-aca895f0-8bc2-4c30-b451-4be25cf1a137 req-0c080d83-4b1c-4c71-8264-c4e8dc234cb2 service nova] Creating event network-vif-unplugged:714a062f-8189-4905-b41f-619554697056 for instance 75a68333-dc4d-48d9-84c6-4c7cd515853e on user Apr 13 15:25:24 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-aca895f0-8bc2-4c30-b451-4be25cf1a137 req-0c080d83-4b1c-4c71-8264-c4e8dc234cb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033664 Apr 13 15:25:24 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 253/750] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:25:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:24 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-9b9178b6-2bec-4633-b61c-08a1d0fda44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedd34ccc15c47f9a4fc96b080730acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3ba2d132c445039d0ae30ffd2bc64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:25:24 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-9b9178b6-2bec-4633-b61c-08a1d0fda44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e" status: 200 len: 1670 microversion: 2.1 time: 0.553933 Apr 13 15:25:24 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 252/751] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:25:24 2023] GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e => generated 1670 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:25:25 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2052126560", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "networks": [{"uuid": "8c2be808-8e48-40ed-8182-2243a199bf06"}]}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:25:25 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] validate_networks() for [('8c2be808-8e48-40ed-8182-2243a199bf06', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:25:25 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:25:25 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:25:25 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:25:25 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:25:25 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:25:25 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:25:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:25 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:25:25 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Getting quotas for project 1ac07b9454744832b26bf6bd126763ec. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:25:25 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Getting quotas for user 3a6955546e4f4292a25acad709d27953 and project 1ac07b9454744832b26bf6bd126763ec. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:25:25 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:25:25 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:25:25 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.639210 Apr 13 15:25:25 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 247/752] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:25:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:25:25 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-5b17cec0-c249-438b-9f1c-c0e387958628 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:25 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-5b17cec0-c249-438b-9f1c-c0e387958628 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:25 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-5b17cec0-c249-438b-9f1c-c0e387958628 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6955546e4f4292a25acad709d27953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac07b9454744832b26bf6bd126763ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:25:25 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-5b17cec0-c249-438b-9f1c-c0e387958628 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22bb22bd-efa8-4679-979a-dd0ce28a79e3" status: 200 len: 1211 microversion: 2.1 time: 0.071532 Apr 13 15:25:25 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 254/753] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:25:25 2023] GET /compute/v2.1/servers/22bb22bd-efa8-4679-979a-dd0ce28a79e3 => generated 1211 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:25:25 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-876e6df4-6215-4c17-af4c-eca16808dbff req-326d92f7-6196-44e0-a7ed-1f12897d0b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a68333-dc4d-48d9-84c6-4c7cd515853e", "name": "network-vif-deleted", "tag": "714a062f-8189-4905-b41f-619554697056"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:25:25 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=25 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:25:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-876e6df4-6215-4c17-af4c-eca16808dbff req-326d92f7-6196-44e0-a7ed-1f12897d0b14 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-876e6df4-6215-4c17-af4c-eca16808dbff req-326d92f7-6196-44e0-a7ed-1f12897d0b14 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-876e6df4-6215-4c17-af4c-eca16808dbff req-326d92f7-6196-44e0-a7ed-1f12897d0b14 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:25 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:25:25 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-876e6df4-6215-4c17-af4c-eca16808dbff req-326d92f7-6196-44e0-a7ed-1f12897d0b14 service nova] Creating event network-vif-deleted:714a062f-8189-4905-b41f-619554697056 for instance 75a68333-dc4d-48d9-84c6-4c7cd515853e on user Apr 13 15:25:25 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-876e6df4-6215-4c17-af4c-eca16808dbff req-326d92f7-6196-44e0-a7ed-1f12897d0b14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032642 Apr 13 15:25:25 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 253/754] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:25:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:26 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-c129186f-dc3f-4595-ae0a-2a6d40062ffc req-1ae0b6cf-d3e2-4c9b-8929-4523c2f80be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a68333-dc4d-48d9-84c6-4c7cd515853e", "name": "network-vif-plugged", "status": "completed", "tag": "714a062f-8189-4905-b41f-619554697056"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:25:26 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c129186f-dc3f-4595-ae0a-2a6d40062ffc req-1ae0b6cf-d3e2-4c9b-8929-4523c2f80be5 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:26 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c129186f-dc3f-4595-ae0a-2a6d40062ffc req-1ae0b6cf-d3e2-4c9b-8929-4523c2f80be5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:26 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c129186f-dc3f-4595-ae0a-2a6d40062ffc req-1ae0b6cf-d3e2-4c9b-8929-4523c2f80be5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:26 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-c129186f-dc3f-4595-ae0a-2a6d40062ffc req-1ae0b6cf-d3e2-4c9b-8929-4523c2f80be5 service nova] Creating event network-vif-plugged:714a062f-8189-4905-b41f-619554697056 for instance 75a68333-dc4d-48d9-84c6-4c7cd515853e on user Apr 13 15:25:26 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-c129186f-dc3f-4595-ae0a-2a6d40062ffc req-1ae0b6cf-d3e2-4c9b-8929-4523c2f80be5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029476 Apr 13 15:25:26 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 248/755] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:25:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:27 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-7f4fae0a-0003-44e2-9f86-84d17a461ce1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:27 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-7f4fae0a-0003-44e2-9f86-84d17a461ce1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:27 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=27 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:25:27 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7f4fae0a-0003-44e2-9f86-84d17a461ce1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:27 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7f4fae0a-0003-44e2-9f86-84d17a461ce1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:27 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7f4fae0a-0003-44e2-9f86-84d17a461ce1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:27 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7f4fae0a-0003-44e2-9f86-84d17a461ce1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:27 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7f4fae0a-0003-44e2-9f86-84d17a461ce1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:27 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7f4fae0a-0003-44e2-9f86-84d17a461ce1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:27 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:25:27 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-7f4fae0a-0003-44e2-9f86-84d17a461ce1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] HTTP exception thrown: Instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f could not be found. Apr 13 15:25:27 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-7f4fae0a-0003-44e2-9f86-84d17a461ce1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Request method failure captured: Apr 13 15:25:27 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f HTTP/1.1 Apr 13 15:25:27 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:25:27 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:25:27 user devstack@n-api.service[61872]: Connection: close Apr 13 15:25:27 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:25:27 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:25:27 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:25:27 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:25:27 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:25:27 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBq0G06yy_S0S-CbKNk_aJgmQk-1S845U9g-GbAd_dowTuItPmG6TAi6xeljGQ3NDYEU_gQTLkfEb5D0nrDi6EYOMoLCCKW4BhYYN-wmrZax_yeJDN3FdNMU-aPzV4v7tc9FIc0V-2OA1-LDIpzzHgahgDhvIMQD4Jd2vaRpj2ax6ok Apr 13 15:25:27 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:25:27 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:25:27 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:25:27 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:25:27 user devstack@n-api.service[61872]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 15:25:27 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:25:27 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:25:27 user devstack@n-api.service[61872]: X-Project-Id: 240b28f42732478ba732994b2c9e3fbe Apr 13 15:25:27 user devstack@n-api.service[61872]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1009244781 Apr 13 15:25:27 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:25:27 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:25:27 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/240b28f42732478ba732994b2c9e3fbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/240b28f42732478ba732994b2c9e3fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/240b28f42732478ba732994b2c9e3fbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:25:27 user devstack@n-api.service[61872]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1009244781 Apr 13 15:25:27 user devstack@n-api.service[61872]: X-Tenant-Id: 240b28f42732478ba732994b2c9e3fbe Apr 13 15:25:27 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1009244781 Apr 13 15:25:27 user devstack@n-api.service[61872]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member Apr 13 15:25:27 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:25:27 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:25:27 user devstack@n-api.service[61872]: X-User-Id: 75bf6e19993f4c2e90fd52c4d6212622 Apr 13 15:25:27 user devstack@n-api.service[61872]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member Apr 13 15:25:27 user devstack@n-api.service[61872]: method: > Apr 13 15:25:27 user devstack@n-api.service[61872]: exception: Instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f could not be found. Apr 13 15:25:27 user devstack@n-api.service[61872]: action_args: {'id': 'c609c1d1-edcf-4b71-abea-5dd95ebcd81f'} Apr 13 15:25:27 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f could not be found. Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f could not be found. Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f could not be found. Apr 13 15:25:27 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:25:27 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-7f4fae0a-0003-44e2-9f86-84d17a461ce1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Returning 404 to user: Instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:25:27 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-7f4fae0a-0003-44e2-9f86-84d17a461ce1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f" status: 404 len: 111 microversion: 2.87 time: 0.033506 Apr 13 15:25:27 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 255/756] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:25:27 2023] GET /compute/v2.1/servers/c609c1d1-edcf-4b71-abea-5dd95ebcd81f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:25:28 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-76d84853-4a09-4211-ad40-56fd9567a07a req-e083b406-a391-4d15-b471-9def8cd11a7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22bb22bd-efa8-4679-979a-dd0ce28a79e3", "tag": "51fbfc5f-6a68-41b6-9153-192b47c76902"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:25:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-76d84853-4a09-4211-ad40-56fd9567a07a req-e083b406-a391-4d15-b471-9def8cd11a7d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-76d84853-4a09-4211-ad40-56fd9567a07a req-e083b406-a391-4d15-b471-9def8cd11a7d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-76d84853-4a09-4211-ad40-56fd9567a07a req-e083b406-a391-4d15-b471-9def8cd11a7d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:28 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-76d84853-4a09-4211-ad40-56fd9567a07a req-e083b406-a391-4d15-b471-9def8cd11a7d service nova] Creating event network-changed:51fbfc5f-6a68-41b6-9153-192b47c76902 for instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 on user Apr 13 15:25:28 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-76d84853-4a09-4211-ad40-56fd9567a07a req-e083b406-a391-4d15-b471-9def8cd11a7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030717 Apr 13 15:25:28 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 254/757] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:25:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:28 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:28 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:28 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:28 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Going to try to terminate instance {{(pid=61871) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:25:28 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/149f8be9-79d3-4922-b3cc-c164b8b81534" status: 204 len: 0 microversion: 2.87 time: 0.108028 Apr 13 15:25:28 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 249/758] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 15:25:28 2023] DELETE /compute/v2.1/servers/149f8be9-79d3-4922-b3cc-c164b8b81534 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 15:25:28 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-c321522c-5f50-4f83-9622-60dfdab191d1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:28 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-c321522c-5f50-4f83-9622-60dfdab191d1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c321522c-5f50-4f83-9622-60dfdab191d1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c321522c-5f50-4f83-9622-60dfdab191d1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c321522c-5f50-4f83-9622-60dfdab191d1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c321522c-5f50-4f83-9622-60dfdab191d1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c321522c-5f50-4f83-9622-60dfdab191d1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c321522c-5f50-4f83-9622-60dfdab191d1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:28 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-c321522c-5f50-4f83-9622-60dfdab191d1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:25:28 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-c321522c-5f50-4f83-9622-60dfdab191d1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:25:28 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-c321522c-5f50-4f83-9622-60dfdab191d1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:25:28 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-c321522c-5f50-4f83-9622-60dfdab191d1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/149f8be9-79d3-4922-b3cc-c164b8b81534" status: 200 len: 1696 microversion: 2.87 time: 0.209655 Apr 13 15:25:28 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 256/759] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:25:28 2023] GET /compute/v2.1/servers/149f8be9-79d3-4922-b3cc-c164b8b81534 => generated 1696 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:25:28 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-580de49c-0e16-405c-b03a-50535f41d491 req-93d9d914-b3e3-431e-84f2-1b575b0c6a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149f8be9-79d3-4922-b3cc-c164b8b81534", "name": "network-vif-unplugged", "status": "completed", "tag": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:25:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-580de49c-0e16-405c-b03a-50535f41d491 req-93d9d914-b3e3-431e-84f2-1b575b0c6a33 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-580de49c-0e16-405c-b03a-50535f41d491 req-93d9d914-b3e3-431e-84f2-1b575b0c6a33 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-580de49c-0e16-405c-b03a-50535f41d491 req-93d9d914-b3e3-431e-84f2-1b575b0c6a33 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:28 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-580de49c-0e16-405c-b03a-50535f41d491 req-93d9d914-b3e3-431e-84f2-1b575b0c6a33 service nova] Creating event network-vif-unplugged:67be9d84-c425-4bd9-8b9e-6ea31add6ccf for instance 149f8be9-79d3-4922-b3cc-c164b8b81534 on user Apr 13 15:25:28 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-580de49c-0e16-405c-b03a-50535f41d491 req-93d9d914-b3e3-431e-84f2-1b575b0c6a33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030615 Apr 13 15:25:28 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 255/760] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:25:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:30 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-750b2723-1b5a-4c78-bc80-bf3b80f32a76 req-168747c1-380f-4c3c-a35f-368cb630b5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149f8be9-79d3-4922-b3cc-c164b8b81534", "name": "network-vif-deleted", "tag": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:25:30 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-750b2723-1b5a-4c78-bc80-bf3b80f32a76 req-168747c1-380f-4c3c-a35f-368cb630b5a5 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:30 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-750b2723-1b5a-4c78-bc80-bf3b80f32a76 req-168747c1-380f-4c3c-a35f-368cb630b5a5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:30 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-750b2723-1b5a-4c78-bc80-bf3b80f32a76 req-168747c1-380f-4c3c-a35f-368cb630b5a5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:30 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-750b2723-1b5a-4c78-bc80-bf3b80f32a76 req-168747c1-380f-4c3c-a35f-368cb630b5a5 service nova] Creating event network-vif-deleted:67be9d84-c425-4bd9-8b9e-6ea31add6ccf for instance 149f8be9-79d3-4922-b3cc-c164b8b81534 on user Apr 13 15:25:30 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-750b2723-1b5a-4c78-bc80-bf3b80f32a76 req-168747c1-380f-4c3c-a35f-368cb630b5a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090229 Apr 13 15:25:30 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 250/761] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:25:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:30 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-a1904906-f34e-457d-be48-f93541b103d6 req-b57db58c-3b24-4ee2-a34e-950af419c04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149f8be9-79d3-4922-b3cc-c164b8b81534", "name": "network-vif-plugged", "status": "completed", "tag": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:25:30 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a1904906-f34e-457d-be48-f93541b103d6 req-b57db58c-3b24-4ee2-a34e-950af419c04f service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:30 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a1904906-f34e-457d-be48-f93541b103d6 req-b57db58c-3b24-4ee2-a34e-950af419c04f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:30 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a1904906-f34e-457d-be48-f93541b103d6 req-b57db58c-3b24-4ee2-a34e-950af419c04f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:30 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-a1904906-f34e-457d-be48-f93541b103d6 req-b57db58c-3b24-4ee2-a34e-950af419c04f service nova] Creating event network-vif-plugged:67be9d84-c425-4bd9-8b9e-6ea31add6ccf for instance 149f8be9-79d3-4922-b3cc-c164b8b81534 on user Apr 13 15:25:30 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-a1904906-f34e-457d-be48-f93541b103d6 req-b57db58c-3b24-4ee2-a34e-950af419c04f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043594 Apr 13 15:25:30 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 257/762] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:25:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:25:32 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-c1f11554-7c13-41c3-931a-7931ff6f9c16 req-17ee1c2a-25b3-4c9e-a84a-f008feab60db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22bb22bd-efa8-4679-979a-dd0ce28a79e3", "name": "network-vif-plugged", "status": "completed", "tag": "51fbfc5f-6a68-41b6-9153-192b47c76902"}, {"server_uuid": "22bb22bd-efa8-4679-979a-dd0ce28a79e3", "name": "network-vif-plugged", "status": "completed", "tag": "51fbfc5f-6a68-41b6-9153-192b47c76902"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:25:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c1f11554-7c13-41c3-931a-7931ff6f9c16 req-17ee1c2a-25b3-4c9e-a84a-f008feab60db service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c1f11554-7c13-41c3-931a-7931ff6f9c16 req-17ee1c2a-25b3-4c9e-a84a-f008feab60db service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c1f11554-7c13-41c3-931a-7931ff6f9c16 req-17ee1c2a-25b3-4c9e-a84a-f008feab60db service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:32 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-c1f11554-7c13-41c3-931a-7931ff6f9c16 req-17ee1c2a-25b3-4c9e-a84a-f008feab60db service nova] Creating event network-vif-plugged:51fbfc5f-6a68-41b6-9153-192b47c76902 for instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 on user Apr 13 15:25:32 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-c1f11554-7c13-41c3-931a-7931ff6f9c16 req-17ee1c2a-25b3-4c9e-a84a-f008feab60db service nova] Creating event network-vif-plugged:51fbfc5f-6a68-41b6-9153-192b47c76902 for instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 on user Apr 13 15:25:32 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-c1f11554-7c13-41c3-931a-7931ff6f9c16 req-17ee1c2a-25b3-4c9e-a84a-f008feab60db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028736 Apr 13 15:25:32 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 256/763] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:25:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:25:56 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-aa601b80-bf75-4070-8707-e18639bef1c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:25:56 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-aa601b80-bf75-4070-8707-e18639bef1c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:56 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:25:56 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:25:56 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:25:56 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:25:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-aa601b80-bf75-4070-8707-e18639bef1c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-aa601b80-bf75-4070-8707-e18639bef1c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-aa601b80-bf75-4070-8707-e18639bef1c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-aa601b80-bf75-4070-8707-e18639bef1c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-aa601b80-bf75-4070-8707-e18639bef1c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-aa601b80-bf75-4070-8707-e18639bef1c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:56 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-aa601b80-bf75-4070-8707-e18639bef1c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061826 Apr 13 15:25:56 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 251/764] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:25:56 2023] GET /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:25:58 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:25:58 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=7 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:25:58 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=9 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:25:58 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-1884066718"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:25:58 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:25:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:25:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:25:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:25:59 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "POST /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95/action" status: 202 len: 0 microversion: 2.1 time: 0.870251 Apr 13 15:25:59 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 258/765] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:25:58 2023] POST /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95/action => generated 0 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 13 15:26:01 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=7 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:26:01 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=7 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:26:01 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f85f3350-6a5f-49e5-bc42-889e95c46d90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:01 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-f85f3350-6a5f-49e5-bc42-889e95c46d90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:26:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f85f3350-6a5f-49e5-bc42-889e95c46d90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f85f3350-6a5f-49e5-bc42-889e95c46d90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f85f3350-6a5f-49e5-bc42-889e95c46d90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f85f3350-6a5f-49e5-bc42-889e95c46d90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f85f3350-6a5f-49e5-bc42-889e95c46d90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f85f3350-6a5f-49e5-bc42-889e95c46d90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:01 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-f85f3350-6a5f-49e5-bc42-889e95c46d90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] HTTP exception thrown: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:26:01 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f85f3350-6a5f-49e5-bc42-889e95c46d90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Request method failure captured: Apr 13 15:26:01 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 HTTP/1.1 Apr 13 15:26:01 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:26:01 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:26:01 user devstack@n-api.service[61873]: Connection: close Apr 13 15:26:01 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:26:01 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:26:01 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:26:01 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:26:01 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:26:01 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBurKJYr8ku-a9sArMgKGf_zkPYe813RFy3hL9gqm2lA8nA6HuO5sIKmld2K9ueWSJVv5odFcnKlFc37QtLWXaIxLt9FyBSC8ppfxnpaWtL0HffjHjpcF-R5kmgCDC1i3LhNS5BS_s2X-f1QR1QIvxPG-vNqAgSRbD8S_rxbpklmlLk Apr 13 15:26:01 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:26:01 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:26:01 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:26:01 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:26:01 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:26:01 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:26:01 user devstack@n-api.service[61873]: X-Project-Id: 9154e4239a1a42a3820c27563ba0513f Apr 13 15:26:01 user devstack@n-api.service[61873]: X-Project-Name: tempest-ServerActionsTestJSON-423674903 Apr 13 15:26:01 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:26:01 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:26:01 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:26:01 user devstack@n-api.service[61873]: X-Tenant: tempest-ServerActionsTestJSON-423674903 Apr 13 15:26:01 user devstack@n-api.service[61873]: X-Tenant-Id: 9154e4239a1a42a3820c27563ba0513f Apr 13 15:26:01 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-ServerActionsTestJSON-423674903 Apr 13 15:26:01 user devstack@n-api.service[61873]: X-User: tempest-ServerActionsTestJSON-423674903-project-member Apr 13 15:26:01 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:26:01 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:26:01 user devstack@n-api.service[61873]: X-User-Id: 3c12c62d4137473596571e523163e718 Apr 13 15:26:01 user devstack@n-api.service[61873]: X-User-Name: tempest-ServerActionsTestJSON-423674903-project-member Apr 13 15:26:01 user devstack@n-api.service[61873]: method: > Apr 13 15:26:01 user devstack@n-api.service[61873]: exception: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:26:01 user devstack@n-api.service[61873]: action_args: {'id': 'ccc7b5bd-5f78-448e-bd82-74b2263dff75'} Apr 13 15:26:01 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:26:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:26:01 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f85f3350-6a5f-49e5-bc42-889e95c46d90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Returning 404 to user: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:26:01 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-f85f3350-6a5f-49e5-bc42-889e95c46d90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 404 len: 111 microversion: 2.1 time: 0.035578 Apr 13 15:26:01 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 257/766] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:26:01 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:26:01 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-a3a833b9-8166-428a-bba6-1d0a452f8855 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:01 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-a3a833b9-8166-428a-bba6-1d0a452f8855 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:26:01 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a3a833b9-8166-428a-bba6-1d0a452f8855 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:01 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a3a833b9-8166-428a-bba6-1d0a452f8855 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:01 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a3a833b9-8166-428a-bba6-1d0a452f8855 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:01 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a3a833b9-8166-428a-bba6-1d0a452f8855 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:01 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a3a833b9-8166-428a-bba6-1d0a452f8855 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:01 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a3a833b9-8166-428a-bba6-1d0a452f8855 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:01 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-a3a833b9-8166-428a-bba6-1d0a452f8855 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] HTTP exception thrown: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:26:01 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-a3a833b9-8166-428a-bba6-1d0a452f8855 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Request method failure captured: Apr 13 15:26:01 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/os-volume_attachments HTTP/1.1 Apr 13 15:26:01 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:26:01 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:26:01 user devstack@n-api.service[61871]: Connection: close Apr 13 15:26:01 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:26:01 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:26:01 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:26:01 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:26:01 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:26:01 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBurKJYr8ku-a9sArMgKGf_zkPYe813RFy3hL9gqm2lA8nA6HuO5sIKmld2K9ueWSJVv5odFcnKlFc37QtLWXaIxLt9FyBSC8ppfxnpaWtL0HffjHjpcF-R5kmgCDC1i3LhNS5BS_s2X-f1QR1QIvxPG-vNqAgSRbD8S_rxbpklmlLk Apr 13 15:26:01 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:26:01 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:26:01 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:26:01 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:26:01 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:26:01 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:26:01 user devstack@n-api.service[61871]: X-Project-Id: 9154e4239a1a42a3820c27563ba0513f Apr 13 15:26:01 user devstack@n-api.service[61871]: X-Project-Name: tempest-ServerActionsTestJSON-423674903 Apr 13 15:26:01 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:26:01 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:26:01 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:26:01 user devstack@n-api.service[61871]: X-Tenant: tempest-ServerActionsTestJSON-423674903 Apr 13 15:26:01 user devstack@n-api.service[61871]: X-Tenant-Id: 9154e4239a1a42a3820c27563ba0513f Apr 13 15:26:01 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-ServerActionsTestJSON-423674903 Apr 13 15:26:01 user devstack@n-api.service[61871]: X-User: tempest-ServerActionsTestJSON-423674903-project-member Apr 13 15:26:01 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:26:01 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:26:01 user devstack@n-api.service[61871]: X-User-Id: 3c12c62d4137473596571e523163e718 Apr 13 15:26:01 user devstack@n-api.service[61871]: X-User-Name: tempest-ServerActionsTestJSON-423674903-project-member Apr 13 15:26:01 user devstack@n-api.service[61871]: method: > Apr 13 15:26:01 user devstack@n-api.service[61871]: exception: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:26:01 user devstack@n-api.service[61871]: action_args: {'server_id': 'ccc7b5bd-5f78-448e-bd82-74b2263dff75'} Apr 13 15:26:01 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:26:01 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:01 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-a3a833b9-8166-428a-bba6-1d0a452f8855 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Returning 404 to user: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:26:01 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-a3a833b9-8166-428a-bba6-1d0a452f8855 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030244 Apr 13 15:26:01 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 252/767] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:26:01 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:26:01 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-4007be5b-ad1c-4d42-a672-26fc556f905e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:01 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-4007be5b-ad1c-4d42-a672-26fc556f905e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:26:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4007be5b-ad1c-4d42-a672-26fc556f905e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4007be5b-ad1c-4d42-a672-26fc556f905e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4007be5b-ad1c-4d42-a672-26fc556f905e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4007be5b-ad1c-4d42-a672-26fc556f905e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4007be5b-ad1c-4d42-a672-26fc556f905e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4007be5b-ad1c-4d42-a672-26fc556f905e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:01 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-4007be5b-ad1c-4d42-a672-26fc556f905e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] HTTP exception thrown: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:26:01 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-4007be5b-ad1c-4d42-a672-26fc556f905e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Request method failure captured: Apr 13 15:26:01 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 HTTP/1.1 Apr 13 15:26:01 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:26:01 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:26:01 user devstack@n-api.service[61872]: Connection: close Apr 13 15:26:01 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:26:01 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:26:01 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:26:01 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:26:01 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:26:01 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBurKJYr8ku-a9sArMgKGf_zkPYe813RFy3hL9gqm2lA8nA6HuO5sIKmld2K9ueWSJVv5odFcnKlFc37QtLWXaIxLt9FyBSC8ppfxnpaWtL0HffjHjpcF-R5kmgCDC1i3LhNS5BS_s2X-f1QR1QIvxPG-vNqAgSRbD8S_rxbpklmlLk Apr 13 15:26:01 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:26:01 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:26:01 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:26:01 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:26:01 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:26:01 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:26:01 user devstack@n-api.service[61872]: X-Project-Id: 9154e4239a1a42a3820c27563ba0513f Apr 13 15:26:01 user devstack@n-api.service[61872]: X-Project-Name: tempest-ServerActionsTestJSON-423674903 Apr 13 15:26:01 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:26:01 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:26:01 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:26:01 user devstack@n-api.service[61872]: X-Tenant: tempest-ServerActionsTestJSON-423674903 Apr 13 15:26:01 user devstack@n-api.service[61872]: X-Tenant-Id: 9154e4239a1a42a3820c27563ba0513f Apr 13 15:26:01 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-ServerActionsTestJSON-423674903 Apr 13 15:26:01 user devstack@n-api.service[61872]: X-User: tempest-ServerActionsTestJSON-423674903-project-member Apr 13 15:26:01 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:26:01 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:26:01 user devstack@n-api.service[61872]: X-User-Id: 3c12c62d4137473596571e523163e718 Apr 13 15:26:01 user devstack@n-api.service[61872]: X-User-Name: tempest-ServerActionsTestJSON-423674903-project-member Apr 13 15:26:01 user devstack@n-api.service[61872]: method: > Apr 13 15:26:01 user devstack@n-api.service[61872]: exception: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:26:01 user devstack@n-api.service[61872]: action_args: {'id': 'ccc7b5bd-5f78-448e-bd82-74b2263dff75'} Apr 13 15:26:01 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:26:01 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:01 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-4007be5b-ad1c-4d42-a672-26fc556f905e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Returning 404 to user: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:26:01 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-4007be5b-ad1c-4d42-a672-26fc556f905e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 404 len: 111 microversion: 2.1 time: 0.040480 Apr 13 15:26:01 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 259/768] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:26:01 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:26:01 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-635850251", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "networks": [{"uuid": "4ed78a75-b065-400b-8eb2-71085d406a1e"}], "security_groups": [{"name": "tempest-securitygroup--1561728944"}], "key_name": "tempest-keypair-164816521", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:01 user devstack@n-api.service[61873]: DEBUG nova.network.neutron [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] validate_networks() for [('4ed78a75-b065-400b-8eb2-71085d406a1e', None, None, None, None, None)] {{(pid=61873) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:26:02 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:26:02 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:26:02 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:26:02 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:26:02 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:26:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:02 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting quotas for project 9154e4239a1a42a3820c27563ba0513f. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:26:02 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting quotas for user 3c12c62d4137473596571e523163e718 and project 9154e4239a1a42a3820c27563ba0513f. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:26:02 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Going to run 1 instances... {{(pid=61873) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:26:02 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:26:02 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.647112 Apr 13 15:26:02 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 258/769] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:26:01 2023] POST /compute/v2.1/servers => generated 404 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:26:02 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-2047164f-2a2e-415d-95c7-4f499d9872bb tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:02 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-2047164f-2a2e-415d-95c7-4f499d9872bb tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:26:02 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-2047164f-2a2e-415d-95c7-4f499d9872bb tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:26:02 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-2047164f-2a2e-415d-95c7-4f499d9872bb tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58e8e652-d56c-45b6-92ff-a50406ea48e9" status: 200 len: 1231 microversion: 2.1 time: 0.081454 Apr 13 15:26:02 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 253/770] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:26:02 2023] GET /compute/v2.1/servers/58e8e652-d56c-45b6-92ff-a50406ea48e9 => generated 1231 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:26:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-eee1424a-ac20-4c33-833d-8c004cddd6de req-542572ce-0f0f-41e0-a0c1-1997352a6793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e8e652-d56c-45b6-92ff-a50406ea48e9", "tag": "018bebd6-4323-4f9d-8c6d-6da9a7934a97"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-eee1424a-ac20-4c33-833d-8c004cddd6de req-542572ce-0f0f-41e0-a0c1-1997352a6793 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-eee1424a-ac20-4c33-833d-8c004cddd6de req-542572ce-0f0f-41e0-a0c1-1997352a6793 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-eee1424a-ac20-4c33-833d-8c004cddd6de req-542572ce-0f0f-41e0-a0c1-1997352a6793 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:05 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-eee1424a-ac20-4c33-833d-8c004cddd6de req-542572ce-0f0f-41e0-a0c1-1997352a6793 service nova] Creating event network-changed:018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 on user Apr 13 15:26:05 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-eee1424a-ac20-4c33-833d-8c004cddd6de req-542572ce-0f0f-41e0-a0c1-1997352a6793 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031153 Apr 13 15:26:05 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 260/771] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:26:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:26:07 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-ece9f088-71d0-4440-987c-3d6224972b0d req-c45c33fa-7839-404f-917e-46684f46a9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e8e652-d56c-45b6-92ff-a50406ea48e9", "name": "network-vif-plugged", "status": "completed", "tag": "018bebd6-4323-4f9d-8c6d-6da9a7934a97"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-ece9f088-71d0-4440-987c-3d6224972b0d req-c45c33fa-7839-404f-917e-46684f46a9a4 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-ece9f088-71d0-4440-987c-3d6224972b0d req-c45c33fa-7839-404f-917e-46684f46a9a4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-ece9f088-71d0-4440-987c-3d6224972b0d req-c45c33fa-7839-404f-917e-46684f46a9a4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:07 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-ece9f088-71d0-4440-987c-3d6224972b0d req-c45c33fa-7839-404f-917e-46684f46a9a4 service nova] Creating event network-vif-plugged:018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 on user Apr 13 15:26:07 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-ece9f088-71d0-4440-987c-3d6224972b0d req-c45c33fa-7839-404f-917e-46684f46a9a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032875 Apr 13 15:26:07 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 259/772] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:26:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:26:07 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1014644686", "imageRef": "d01d37a3-eaac-4176-9a21-d48e499cdde1", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1982719940", "security_groups": [{"name": "tempest-secgroup-smoke-894451483"}], "networks": [{"uuid": "b494185f-1f0c-4027-8633-d536f480c6d6"}]}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:07 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] validate_networks() for [('b494185f-1f0c-4027-8633-d536f480c6d6', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:26:07 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:26:07 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:26:07 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:26:07 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:26:07 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:26:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:07 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Getting quotas for project 318b9e0eb6a745df811d1daa4d6195fc. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:26:07 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Getting quotas for user 78e289648c244c77ab9ca48154da3cde and project 318b9e0eb6a745df811d1daa4d6195fc. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:26:07 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:26:07 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d01d37a3-eaac-4176-9a21-d48e499cdde1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:26:08 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.644013 Apr 13 15:26:08 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 254/773] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:26:07 2023] POST /compute/v2.1/servers => generated 403 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:26:08 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-8b20a5dd-f8b3-4c5f-8876-253aff6b383c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:08 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-8b20a5dd-f8b3-4c5f-8876-253aff6b383c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:26:08 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-8b20a5dd-f8b3-4c5f-8876-253aff6b383c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e289648c244c77ab9ca48154da3cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318b9e0eb6a745df811d1daa4d6195fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:26:08 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-8b20a5dd-f8b3-4c5f-8876-253aff6b383c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0" status: 200 len: 1237 microversion: 2.1 time: 0.068105 Apr 13 15:26:08 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 261/774] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:26:08 2023] GET /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:26:09 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-f146fd45-0163-475e-99c9-097ae065ce47 req-b4038129-85de-4d7d-b526-42a2de8d6629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e8e652-d56c-45b6-92ff-a50406ea48e9", "name": "network-vif-plugged", "status": "completed", "tag": "018bebd6-4323-4f9d-8c6d-6da9a7934a97"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-f146fd45-0163-475e-99c9-097ae065ce47 req-b4038129-85de-4d7d-b526-42a2de8d6629 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-f146fd45-0163-475e-99c9-097ae065ce47 req-b4038129-85de-4d7d-b526-42a2de8d6629 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-f146fd45-0163-475e-99c9-097ae065ce47 req-b4038129-85de-4d7d-b526-42a2de8d6629 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:09 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-f146fd45-0163-475e-99c9-097ae065ce47 req-b4038129-85de-4d7d-b526-42a2de8d6629 service nova] Creating event network-vif-plugged:018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 on user Apr 13 15:26:09 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-f146fd45-0163-475e-99c9-097ae065ce47 req-b4038129-85de-4d7d-b526-42a2de8d6629 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030879 Apr 13 15:26:09 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 260/775] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:26:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:26:10 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-41e3f959-227a-4271-8594-4f26ec9ca76a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:10 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-41e3f959-227a-4271-8594-4f26ec9ca76a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:26:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-41e3f959-227a-4271-8594-4f26ec9ca76a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-41e3f959-227a-4271-8594-4f26ec9ca76a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-41e3f959-227a-4271-8594-4f26ec9ca76a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-41e3f959-227a-4271-8594-4f26ec9ca76a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-41e3f959-227a-4271-8594-4f26ec9ca76a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-41e3f959-227a-4271-8594-4f26ec9ca76a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:10 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-41e3f959-227a-4271-8594-4f26ec9ca76a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] HTTP exception thrown: Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a could not be found. Apr 13 15:26:10 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-41e3f959-227a-4271-8594-4f26ec9ca76a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Request method failure captured: Apr 13 15:26:10 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a HTTP/1.1 Apr 13 15:26:10 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:26:10 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:26:10 user devstack@n-api.service[61871]: Connection: close Apr 13 15:26:10 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:26:10 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:26:10 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:26:10 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:26:10 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:26:10 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBvow86gKNivuTB6ogWrqnOwepE4zg3bO1TSkkhG4US5BzkcqviMiBl4o_Y72I8KnOpJNzaOP0L4BvBiTe4UMLYWqP2o1bg1BxN5lSjLigwpexmFWGaKRti0NJVFmd6pOG0hkt4lffEJudP_49AuScJSlFQVBzmFpGiyd60BhSgssJk Apr 13 15:26:10 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:26:10 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:26:10 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:26:10 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:26:10 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:26:10 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:26:10 user devstack@n-api.service[61871]: X-Project-Id: ceba33821a9b4f7aa81c2857c11261f1 Apr 13 15:26:10 user devstack@n-api.service[61871]: X-Project-Name: tempest-AttachVolumeTestJSON-157319562 Apr 13 15:26:10 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:26:10 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:26:10 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ceba33821a9b4f7aa81c2857c11261f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ceba33821a9b4f7aa81c2857c11261f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ceba33821a9b4f7aa81c2857c11261f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:26:10 user devstack@n-api.service[61871]: X-Tenant: tempest-AttachVolumeTestJSON-157319562 Apr 13 15:26:10 user devstack@n-api.service[61871]: X-Tenant-Id: ceba33821a9b4f7aa81c2857c11261f1 Apr 13 15:26:10 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-AttachVolumeTestJSON-157319562 Apr 13 15:26:10 user devstack@n-api.service[61871]: X-User: tempest-AttachVolumeTestJSON-157319562-project-member Apr 13 15:26:10 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:26:10 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:26:10 user devstack@n-api.service[61871]: X-User-Id: de1a698b103a47c0b2864eef54be648b Apr 13 15:26:10 user devstack@n-api.service[61871]: X-User-Name: tempest-AttachVolumeTestJSON-157319562-project-member Apr 13 15:26:10 user devstack@n-api.service[61871]: method: > Apr 13 15:26:10 user devstack@n-api.service[61871]: exception: Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a could not be found. Apr 13 15:26:10 user devstack@n-api.service[61871]: action_args: {'id': 'f093cc8b-83cd-4154-8b4e-a98481e2c42a'} Apr 13 15:26:10 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a could not be found. Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a could not be found. Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a could not be found. Apr 13 15:26:10 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:10 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-41e3f959-227a-4271-8594-4f26ec9ca76a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Returning 404 to user: Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:26:10 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-41e3f959-227a-4271-8594-4f26ec9ca76a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a" status: 404 len: 111 microversion: 2.1 time: 0.036841 Apr 13 15:26:10 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 255/776] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:26:10 2023] GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:26:10 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-f376172a-9175-4a63-94db-660819745b5b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '.version_select at 0x7f3a8f796c20>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:10 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-f376172a-9175-4a63-94db-660819745b5b tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1855443748" status: 202 len: 0 microversion: 2.1 time: 0.023937 Apr 13 15:26:10 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 262/777] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 15:26:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1855443748 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 15:26:11 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-5c27b38e-04d1-4bdd-b299-7f9b99af7f4e req-69712e62-6951-48a8-9124-8529b562d55a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed13cfeb-933e-4cff-804a-f7404df7f2b0", "tag": "f72dcc71-6349-4489-8605-18cb581b5750"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5c27b38e-04d1-4bdd-b299-7f9b99af7f4e req-69712e62-6951-48a8-9124-8529b562d55a service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5c27b38e-04d1-4bdd-b299-7f9b99af7f4e req-69712e62-6951-48a8-9124-8529b562d55a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5c27b38e-04d1-4bdd-b299-7f9b99af7f4e req-69712e62-6951-48a8-9124-8529b562d55a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:11 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-5c27b38e-04d1-4bdd-b299-7f9b99af7f4e req-69712e62-6951-48a8-9124-8529b562d55a service nova] Creating event network-changed:f72dcc71-6349-4489-8605-18cb581b5750 for instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 on user Apr 13 15:26:11 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-5c27b38e-04d1-4bdd-b299-7f9b99af7f4e req-69712e62-6951-48a8-9124-8529b562d55a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031979 Apr 13 15:26:11 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 261/778] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:26:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:26:12 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-a65880e8-28d0-4a15-9d5b-157a3b7cac38 req-e3db0c04-55a1-478e-a631-ec8a910cd0de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed13cfeb-933e-4cff-804a-f7404df7f2b0", "name": "network-vif-plugged", "status": "completed", "tag": "f72dcc71-6349-4489-8605-18cb581b5750"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a65880e8-28d0-4a15-9d5b-157a3b7cac38 req-e3db0c04-55a1-478e-a631-ec8a910cd0de service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a65880e8-28d0-4a15-9d5b-157a3b7cac38 req-e3db0c04-55a1-478e-a631-ec8a910cd0de service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a65880e8-28d0-4a15-9d5b-157a3b7cac38 req-e3db0c04-55a1-478e-a631-ec8a910cd0de service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:12 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-a65880e8-28d0-4a15-9d5b-157a3b7cac38 req-e3db0c04-55a1-478e-a631-ec8a910cd0de service nova] Creating event network-vif-plugged:f72dcc71-6349-4489-8605-18cb581b5750 for instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 on user Apr 13 15:26:12 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-a65880e8-28d0-4a15-9d5b-157a3b7cac38 req-e3db0c04-55a1-478e-a631-ec8a910cd0de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042469 Apr 13 15:26:12 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 256/779] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:26:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:26:14 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-c7bcd1d8-b16d-4c73-a3fe-8d056387e8b9 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:14 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-c7bcd1d8-b16d-4c73-a3fe-8d056387e8b9 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:26:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c7bcd1d8-b16d-4c73-a3fe-8d056387e8b9 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c7bcd1d8-b16d-4c73-a3fe-8d056387e8b9 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c7bcd1d8-b16d-4c73-a3fe-8d056387e8b9 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c7bcd1d8-b16d-4c73-a3fe-8d056387e8b9 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c7bcd1d8-b16d-4c73-a3fe-8d056387e8b9 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c7bcd1d8-b16d-4c73-a3fe-8d056387e8b9 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:14 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-c7bcd1d8-b16d-4c73-a3fe-8d056387e8b9 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] HTTP exception thrown: Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e could not be found. Apr 13 15:26:14 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-c7bcd1d8-b16d-4c73-a3fe-8d056387e8b9 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Request method failure captured: Apr 13 15:26:14 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e HTTP/1.1 Apr 13 15:26:14 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:26:14 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:26:14 user devstack@n-api.service[61872]: Connection: close Apr 13 15:26:14 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:26:14 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:26:14 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:26:14 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:26:14 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:26:14 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBysJSC_pL1o3J9cVhCfPJH0RJxZJE2XjaF2Yq1nITqHQPAUJ-sY0C6ehk0hgyb5AGui4kwa-lWhEaqyW-11oCzt4s9SAjj7iiHUYBf3mDz8zQD6VpCcWxM23IvnmM9hydVYLDDtvrzvCJbTCSuVNPu3nJmaP7WJ6HL0s88zCkG70Us Apr 13 15:26:14 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:26:14 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:26:14 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:26:14 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:26:14 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:26:14 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:26:14 user devstack@n-api.service[61872]: X-Project-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:26:14 user devstack@n-api.service[61872]: X-Project-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:26:14 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:26:14 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:26:14 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:26:14 user devstack@n-api.service[61872]: X-Tenant: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:26:14 user devstack@n-api.service[61872]: X-Tenant-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:26:14 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:26:14 user devstack@n-api.service[61872]: X-User: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:26:14 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:26:14 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:26:14 user devstack@n-api.service[61872]: X-User-Id: fedd34ccc15c47f9a4fc96b080730acd Apr 13 15:26:14 user devstack@n-api.service[61872]: X-User-Name: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:26:14 user devstack@n-api.service[61872]: method: > Apr 13 15:26:14 user devstack@n-api.service[61872]: exception: Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e could not be found. Apr 13 15:26:14 user devstack@n-api.service[61872]: action_args: {'id': '75a68333-dc4d-48d9-84c6-4c7cd515853e'} Apr 13 15:26:14 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e could not be found. Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e could not be found. Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e could not be found. Apr 13 15:26:14 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:14 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-c7bcd1d8-b16d-4c73-a3fe-8d056387e8b9 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Returning 404 to user: Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:26:14 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-c7bcd1d8-b16d-4c73-a3fe-8d056387e8b9 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e" status: 404 len: 111 microversion: 2.1 time: 0.032917 Apr 13 15:26:14 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 263/780] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:26:14 2023] GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:26:14 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:26:14 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:26:14 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-28b8c9ac-620e-4e96-9822-01430ef4e2c0 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '.version_select at 0x7f3a914b53f0>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:14 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-28b8c9ac-620e-4e96-9822-01430ef4e2c0 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093832726" status: 202 len: 0 microversion: 2.1 time: 0.026711 Apr 13 15:26:14 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 262/781] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 15:26:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093832726 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:26:15 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-1aaa5bae-a63d-4b17-8080-8e43d0a05407 req-d4ba29ec-0389-452f-b9e2-fd4f0d952806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed13cfeb-933e-4cff-804a-f7404df7f2b0", "name": "network-vif-plugged", "status": "completed", "tag": "f72dcc71-6349-4489-8605-18cb581b5750"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-1aaa5bae-a63d-4b17-8080-8e43d0a05407 req-d4ba29ec-0389-452f-b9e2-fd4f0d952806 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-1aaa5bae-a63d-4b17-8080-8e43d0a05407 req-d4ba29ec-0389-452f-b9e2-fd4f0d952806 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-1aaa5bae-a63d-4b17-8080-8e43d0a05407 req-d4ba29ec-0389-452f-b9e2-fd4f0d952806 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:15 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-1aaa5bae-a63d-4b17-8080-8e43d0a05407 req-d4ba29ec-0389-452f-b9e2-fd4f0d952806 service nova] Creating event network-vif-plugged:f72dcc71-6349-4489-8605-18cb581b5750 for instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 on user Apr 13 15:26:15 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-1aaa5bae-a63d-4b17-8080-8e43d0a05407 req-d4ba29ec-0389-452f-b9e2-fd4f0d952806 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037492 Apr 13 15:26:15 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 257/782] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:26:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:26:15 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-6a36d3ca-ecc8-486d-ab75-8fd4fa36b49b tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Action: 'create', calling method: .version_select at 0x7f3a8f8f6b00>, body: {"keypair": {"name": "tempest-keypair-99368010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBeFSuWghn2ppx3LV4kwZSZ9u3eFqKrqHzSj6nztIlK6sepsmjvLDfGRp5YpOTa3ynO1wxxPjRYQuPWi1qCH33zqkCZqjkRoS2IFUvCmStWVu+wnE1oyDC/D062bqzoaw=="}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:15 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-6a36d3ca-ecc8-486d-ab75-8fd4fa36b49b tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting quotas for project 3e3ba2d132c445039d0ae30ffd2bc64a. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:26:15 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-6a36d3ca-ecc8-486d-ab75-8fd4fa36b49b tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting quotas for user fedd34ccc15c47f9a4fc96b080730acd and project 3e3ba2d132c445039d0ae30ffd2bc64a. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:26:15 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-6a36d3ca-ecc8-486d-ab75-8fd4fa36b49b tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.048087 Apr 13 15:26:15 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 264/783] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 15:26:15 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:26:15 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-64fc5ecc-32f3-461c-b065-76778c1c5b31 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:15 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-64fc5ecc-32f3-461c-b065-76778c1c5b31 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:26:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-64fc5ecc-32f3-461c-b065-76778c1c5b31 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-64fc5ecc-32f3-461c-b065-76778c1c5b31 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-64fc5ecc-32f3-461c-b065-76778c1c5b31 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-64fc5ecc-32f3-461c-b065-76778c1c5b31 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-64fc5ecc-32f3-461c-b065-76778c1c5b31 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-64fc5ecc-32f3-461c-b065-76778c1c5b31 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:15 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-64fc5ecc-32f3-461c-b065-76778c1c5b31 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6955546e4f4292a25acad709d27953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac07b9454744832b26bf6bd126763ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:26:15 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-64fc5ecc-32f3-461c-b065-76778c1c5b31 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22bb22bd-efa8-4679-979a-dd0ce28a79e3" status: 200 len: 1493 microversion: 2.1 time: 0.189461 Apr 13 15:26:15 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 263/784] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:26:15 2023] GET /compute/v2.1/servers/22bb22bd-efa8-4679-979a-dd0ce28a79e3 => generated 1493 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:26:16 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-b24f89e5-887f-49d3-851a-4ca62eaaf585 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:16 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-b24f89e5-887f-49d3-851a-4ca62eaaf585 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:26:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b24f89e5-887f-49d3-851a-4ca62eaaf585 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b24f89e5-887f-49d3-851a-4ca62eaaf585 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b24f89e5-887f-49d3-851a-4ca62eaaf585 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b24f89e5-887f-49d3-851a-4ca62eaaf585 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b24f89e5-887f-49d3-851a-4ca62eaaf585 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b24f89e5-887f-49d3-851a-4ca62eaaf585 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:16 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-b24f89e5-887f-49d3-851a-4ca62eaaf585 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] HTTP exception thrown: Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a could not be found. Apr 13 15:26:16 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-b24f89e5-887f-49d3-851a-4ca62eaaf585 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Request method failure captured: Apr 13 15:26:16 user devstack@n-api.service[61871]: request: DELETE /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a HTTP/1.1 Apr 13 15:26:16 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:26:16 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:26:16 user devstack@n-api.service[61871]: Connection: close Apr 13 15:26:16 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:26:16 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:26:16 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:26:16 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:26:16 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:26:16 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBvow86gKNivuTB6ogWrqnOwepE4zg3bO1TSkkhG4US5BzkcqviMiBl4o_Y72I8KnOpJNzaOP0L4BvBiTe4UMLYWqP2o1bg1BxN5lSjLigwpexmFWGaKRti0NJVFmd6pOG0hkt4lffEJudP_49AuScJSlFQVBzmFpGiyd60BhSgssJk Apr 13 15:26:16 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:26:16 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:26:16 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:26:16 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:26:16 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:26:16 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:26:16 user devstack@n-api.service[61871]: X-Project-Id: ceba33821a9b4f7aa81c2857c11261f1 Apr 13 15:26:16 user devstack@n-api.service[61871]: X-Project-Name: tempest-AttachVolumeTestJSON-157319562 Apr 13 15:26:16 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:26:16 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:26:16 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ceba33821a9b4f7aa81c2857c11261f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ceba33821a9b4f7aa81c2857c11261f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ceba33821a9b4f7aa81c2857c11261f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:26:16 user devstack@n-api.service[61871]: X-Tenant: tempest-AttachVolumeTestJSON-157319562 Apr 13 15:26:16 user devstack@n-api.service[61871]: X-Tenant-Id: ceba33821a9b4f7aa81c2857c11261f1 Apr 13 15:26:16 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-AttachVolumeTestJSON-157319562 Apr 13 15:26:16 user devstack@n-api.service[61871]: X-User: tempest-AttachVolumeTestJSON-157319562-project-member Apr 13 15:26:16 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:26:16 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:26:16 user devstack@n-api.service[61871]: X-User-Id: de1a698b103a47c0b2864eef54be648b Apr 13 15:26:16 user devstack@n-api.service[61871]: X-User-Name: tempest-AttachVolumeTestJSON-157319562-project-member Apr 13 15:26:16 user devstack@n-api.service[61871]: method: > Apr 13 15:26:16 user devstack@n-api.service[61871]: exception: Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a could not be found. Apr 13 15:26:16 user devstack@n-api.service[61871]: action_args: {'id': 'f093cc8b-83cd-4154-8b4e-a98481e2c42a'} Apr 13 15:26:16 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a could not be found. Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a could not be found. Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a could not be found. Apr 13 15:26:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:16 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-b24f89e5-887f-49d3-851a-4ca62eaaf585 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Returning 404 to user: Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:26:16 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-b24f89e5-887f-49d3-851a-4ca62eaaf585 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a" status: 404 len: 111 microversion: 2.1 time: 0.030478 Apr 13 15:26:16 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 258/785] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:26:16 2023] DELETE /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:26:16 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-2888d334-dcdf-45a3-a23d-ad21a1650e46 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:16 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-2888d334-dcdf-45a3-a23d-ad21a1650e46 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:26:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2888d334-dcdf-45a3-a23d-ad21a1650e46 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2888d334-dcdf-45a3-a23d-ad21a1650e46 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2888d334-dcdf-45a3-a23d-ad21a1650e46 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2888d334-dcdf-45a3-a23d-ad21a1650e46 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2888d334-dcdf-45a3-a23d-ad21a1650e46 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2888d334-dcdf-45a3-a23d-ad21a1650e46 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:16 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-2888d334-dcdf-45a3-a23d-ad21a1650e46 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] HTTP exception thrown: Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a could not be found. Apr 13 15:26:16 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-2888d334-dcdf-45a3-a23d-ad21a1650e46 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Request method failure captured: Apr 13 15:26:16 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a HTTP/1.1 Apr 13 15:26:16 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:26:16 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:26:16 user devstack@n-api.service[61872]: Connection: close Apr 13 15:26:16 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:26:16 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:26:16 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:26:16 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:26:16 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:26:16 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBvow86gKNivuTB6ogWrqnOwepE4zg3bO1TSkkhG4US5BzkcqviMiBl4o_Y72I8KnOpJNzaOP0L4BvBiTe4UMLYWqP2o1bg1BxN5lSjLigwpexmFWGaKRti0NJVFmd6pOG0hkt4lffEJudP_49AuScJSlFQVBzmFpGiyd60BhSgssJk Apr 13 15:26:16 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:26:16 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:26:16 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:26:16 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:26:16 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:26:16 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:26:16 user devstack@n-api.service[61872]: X-Project-Id: ceba33821a9b4f7aa81c2857c11261f1 Apr 13 15:26:16 user devstack@n-api.service[61872]: X-Project-Name: tempest-AttachVolumeTestJSON-157319562 Apr 13 15:26:16 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:26:16 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:26:16 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ceba33821a9b4f7aa81c2857c11261f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ceba33821a9b4f7aa81c2857c11261f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ceba33821a9b4f7aa81c2857c11261f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:26:16 user devstack@n-api.service[61872]: X-Tenant: tempest-AttachVolumeTestJSON-157319562 Apr 13 15:26:16 user devstack@n-api.service[61872]: X-Tenant-Id: ceba33821a9b4f7aa81c2857c11261f1 Apr 13 15:26:16 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-AttachVolumeTestJSON-157319562 Apr 13 15:26:16 user devstack@n-api.service[61872]: X-User: tempest-AttachVolumeTestJSON-157319562-project-member Apr 13 15:26:16 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:26:16 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:26:16 user devstack@n-api.service[61872]: X-User-Id: de1a698b103a47c0b2864eef54be648b Apr 13 15:26:16 user devstack@n-api.service[61872]: X-User-Name: tempest-AttachVolumeTestJSON-157319562-project-member Apr 13 15:26:16 user devstack@n-api.service[61872]: method: > Apr 13 15:26:16 user devstack@n-api.service[61872]: exception: Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a could not be found. Apr 13 15:26:16 user devstack@n-api.service[61872]: action_args: {'id': 'f093cc8b-83cd-4154-8b4e-a98481e2c42a'} Apr 13 15:26:16 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a could not be found. Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a could not be found. Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a could not be found. Apr 13 15:26:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:16 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-2888d334-dcdf-45a3-a23d-ad21a1650e46 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Returning 404 to user: Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:26:16 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-2888d334-dcdf-45a3-a23d-ad21a1650e46 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a" status: 404 len: 111 microversion: 2.1 time: 0.044160 Apr 13 15:26:16 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 265/786] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:26:16 2023] GET /compute/v2.1/servers/f093cc8b-83cd-4154-8b4e-a98481e2c42a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:26:17 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-478534840", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "547bb22a-22b3-4b8b-ab87-e4eb4af27619"}], "security_groups": [{"name": "tempest-securitygroup--687782173"}], "key_name": "tempest-keypair-99368010", "user_data": "}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:17 user devstack@n-api.service[61873]: DEBUG nova.network.neutron [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] validate_networks() for [('547bb22a-22b3-4b8b-ab87-e4eb4af27619', None, None, None, None, None)] {{(pid=61873) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Flavor limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Image limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Flavor pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Image pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting quotas for project 3e3ba2d132c445039d0ae30ffd2bc64a. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting quotas for user fedd34ccc15c47f9a4fc96b080730acd and project 3e3ba2d132c445039d0ae30ffd2bc64a. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Going to run 1 instances... {{(pid=61873) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:26:18 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.774940 Apr 13 15:26:18 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 264/787] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:26:17 2023] POST /compute/v2.1/servers => generated 399 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:26:18 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-0981a642-33da-451b-8e32-d846f83fa3ad tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:18 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-0981a642-33da-451b-8e32-d846f83fa3ad tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:26:18 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:26:18 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=8 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:26:18 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e2c71608-035e-4a67-9367-67acb8f23112 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:18 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-e2c71608-035e-4a67-9367-67acb8f23112 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:26:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e2c71608-035e-4a67-9367-67acb8f23112 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e2c71608-035e-4a67-9367-67acb8f23112 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e2c71608-035e-4a67-9367-67acb8f23112 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e2c71608-035e-4a67-9367-67acb8f23112 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e2c71608-035e-4a67-9367-67acb8f23112 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e2c71608-035e-4a67-9367-67acb8f23112 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:18 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-0981a642-33da-451b-8e32-d846f83fa3ad tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedd34ccc15c47f9a4fc96b080730acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3ba2d132c445039d0ae30ffd2bc64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:26:18 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-e2c71608-035e-4a67-9367-67acb8f23112 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] HTTP exception thrown: Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 could not be found. Apr 13 15:26:18 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e2c71608-035e-4a67-9367-67acb8f23112 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Request method failure captured: Apr 13 15:26:18 user devstack@n-api.service[61872]: request: DELETE /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3 HTTP/1.1 Apr 13 15:26:18 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:26:18 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:26:18 user devstack@n-api.service[61872]: Connection: close Apr 13 15:26:18 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:26:18 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:26:18 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:26:18 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:26:18 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:26:18 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBvow86gKNivuTB6ogWrqnOwepE4zg3bO1TSkkhG4US5BzkcqviMiBl4o_Y72I8KnOpJNzaOP0L4BvBiTe4UMLYWqP2o1bg1BxN5lSjLigwpexmFWGaKRti0NJVFmd6pOG0hkt4lffEJudP_49AuScJSlFQVBzmFpGiyd60BhSgssJk Apr 13 15:26:18 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:26:18 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:26:18 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:26:18 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:26:18 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:26:18 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:26:18 user devstack@n-api.service[61872]: X-Project-Id: ceba33821a9b4f7aa81c2857c11261f1 Apr 13 15:26:18 user devstack@n-api.service[61872]: X-Project-Name: tempest-AttachVolumeTestJSON-157319562 Apr 13 15:26:18 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:26:18 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:26:18 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ceba33821a9b4f7aa81c2857c11261f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ceba33821a9b4f7aa81c2857c11261f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ceba33821a9b4f7aa81c2857c11261f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:26:18 user devstack@n-api.service[61872]: X-Tenant: tempest-AttachVolumeTestJSON-157319562 Apr 13 15:26:18 user devstack@n-api.service[61872]: X-Tenant-Id: ceba33821a9b4f7aa81c2857c11261f1 Apr 13 15:26:18 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-AttachVolumeTestJSON-157319562 Apr 13 15:26:18 user devstack@n-api.service[61872]: X-User: tempest-AttachVolumeTestJSON-157319562-project-member Apr 13 15:26:18 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:26:18 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:26:18 user devstack@n-api.service[61872]: X-User-Id: de1a698b103a47c0b2864eef54be648b Apr 13 15:26:18 user devstack@n-api.service[61872]: X-User-Name: tempest-AttachVolumeTestJSON-157319562-project-member Apr 13 15:26:18 user devstack@n-api.service[61872]: method: > Apr 13 15:26:18 user devstack@n-api.service[61872]: exception: Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 could not be found. Apr 13 15:26:18 user devstack@n-api.service[61872]: action_args: {'id': '1aa74d14-db6f-41f5-b8af-32da312209d3'} Apr 13 15:26:18 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 could not be found. Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 could not be found. Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 could not be found. Apr 13 15:26:18 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:26:18 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e2c71608-035e-4a67-9367-67acb8f23112 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Returning 404 to user: Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:26:18 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-0981a642-33da-451b-8e32-d846f83fa3ad tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36" status: 200 len: 1233 microversion: 2.1 time: 0.103657 Apr 13 15:26:18 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 259/788] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:26:18 2023] GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36 => generated 1233 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:26:18 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-e2c71608-035e-4a67-9367-67acb8f23112 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3" status: 404 len: 111 microversion: 2.1 time: 0.044470 Apr 13 15:26:18 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 266/789] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:26:18 2023] DELETE /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-637b717b-0c60-488c-82e9-5af290a3b22f tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-637b717b-0c60-488c-82e9-5af290a3b22f tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-637b717b-0c60-488c-82e9-5af290a3b22f tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-637b717b-0c60-488c-82e9-5af290a3b22f tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-637b717b-0c60-488c-82e9-5af290a3b22f tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-637b717b-0c60-488c-82e9-5af290a3b22f tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-637b717b-0c60-488c-82e9-5af290a3b22f tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-637b717b-0c60-488c-82e9-5af290a3b22f tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:18 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-637b717b-0c60-488c-82e9-5af290a3b22f tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] HTTP exception thrown: Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 could not be found. Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-637b717b-0c60-488c-82e9-5af290a3b22f tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Request method failure captured: Apr 13 15:26:18 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3 HTTP/1.1 Apr 13 15:26:18 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:26:18 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:26:18 user devstack@n-api.service[61873]: Connection: close Apr 13 15:26:18 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:26:18 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:26:18 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:26:18 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:26:18 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:26:18 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBvow86gKNivuTB6ogWrqnOwepE4zg3bO1TSkkhG4US5BzkcqviMiBl4o_Y72I8KnOpJNzaOP0L4BvBiTe4UMLYWqP2o1bg1BxN5lSjLigwpexmFWGaKRti0NJVFmd6pOG0hkt4lffEJudP_49AuScJSlFQVBzmFpGiyd60BhSgssJk Apr 13 15:26:18 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:26:18 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:26:18 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:26:18 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:26:18 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:26:18 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:26:18 user devstack@n-api.service[61873]: X-Project-Id: ceba33821a9b4f7aa81c2857c11261f1 Apr 13 15:26:18 user devstack@n-api.service[61873]: X-Project-Name: tempest-AttachVolumeTestJSON-157319562 Apr 13 15:26:18 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:26:18 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:26:18 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ceba33821a9b4f7aa81c2857c11261f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ceba33821a9b4f7aa81c2857c11261f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ceba33821a9b4f7aa81c2857c11261f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:26:18 user devstack@n-api.service[61873]: X-Tenant: tempest-AttachVolumeTestJSON-157319562 Apr 13 15:26:18 user devstack@n-api.service[61873]: X-Tenant-Id: ceba33821a9b4f7aa81c2857c11261f1 Apr 13 15:26:18 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-AttachVolumeTestJSON-157319562 Apr 13 15:26:18 user devstack@n-api.service[61873]: X-User: tempest-AttachVolumeTestJSON-157319562-project-member Apr 13 15:26:18 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:26:18 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:26:18 user devstack@n-api.service[61873]: X-User-Id: de1a698b103a47c0b2864eef54be648b Apr 13 15:26:18 user devstack@n-api.service[61873]: X-User-Name: tempest-AttachVolumeTestJSON-157319562-project-member Apr 13 15:26:18 user devstack@n-api.service[61873]: method: > Apr 13 15:26:18 user devstack@n-api.service[61873]: exception: Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 could not be found. Apr 13 15:26:18 user devstack@n-api.service[61873]: action_args: {'id': '1aa74d14-db6f-41f5-b8af-32da312209d3'} Apr 13 15:26:18 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 could not be found. Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 could not be found. Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 could not be found. Apr 13 15:26:18 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:26:18 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-637b717b-0c60-488c-82e9-5af290a3b22f tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Returning 404 to user: Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:26:18 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-637b717b-0c60-488c-82e9-5af290a3b22f tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3" status: 404 len: 111 microversion: 2.1 time: 0.031717 Apr 13 15:26:18 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 265/790] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:26:18 2023] GET /compute/v2.1/servers/1aa74d14-db6f-41f5-b8af-32da312209d3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:26:18 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-94f19b43-470a-4e55-abb7-bd6a2d8bb561 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:18 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-94f19b43-470a-4e55-abb7-bd6a2d8bb561 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:26:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-94f19b43-470a-4e55-abb7-bd6a2d8bb561 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-94f19b43-470a-4e55-abb7-bd6a2d8bb561 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-94f19b43-470a-4e55-abb7-bd6a2d8bb561 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-94f19b43-470a-4e55-abb7-bd6a2d8bb561 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-94f19b43-470a-4e55-abb7-bd6a2d8bb561 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-94f19b43-470a-4e55-abb7-bd6a2d8bb561 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:18 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-94f19b43-470a-4e55-abb7-bd6a2d8bb561 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] HTTP exception thrown: Instance 149f8be9-79d3-4922-b3cc-c164b8b81534 could not be found. Apr 13 15:26:18 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-94f19b43-470a-4e55-abb7-bd6a2d8bb561 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Request method failure captured: Apr 13 15:26:18 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/149f8be9-79d3-4922-b3cc-c164b8b81534 HTTP/1.1 Apr 13 15:26:18 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:26:18 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:26:18 user devstack@n-api.service[61871]: Connection: close Apr 13 15:26:18 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:26:18 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:26:18 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:26:18 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:26:18 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:26:18 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBq0G06yy_S0S-CbKNk_aJgmQk-1S845U9g-GbAd_dowTuItPmG6TAi6xeljGQ3NDYEU_gQTLkfEb5D0nrDi6EYOMoLCCKW4BhYYN-wmrZax_yeJDN3FdNMU-aPzV4v7tc9FIc0V-2OA1-LDIpzzHgahgDhvIMQD4Jd2vaRpj2ax6ok Apr 13 15:26:18 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:26:18 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:26:18 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:26:18 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:26:18 user devstack@n-api.service[61871]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 15:26:18 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:26:18 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:26:18 user devstack@n-api.service[61871]: X-Project-Id: 240b28f42732478ba732994b2c9e3fbe Apr 13 15:26:18 user devstack@n-api.service[61871]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1009244781 Apr 13 15:26:18 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:26:18 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:26:18 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/240b28f42732478ba732994b2c9e3fbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/240b28f42732478ba732994b2c9e3fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/240b28f42732478ba732994b2c9e3fbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:26:18 user devstack@n-api.service[61871]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1009244781 Apr 13 15:26:18 user devstack@n-api.service[61871]: X-Tenant-Id: 240b28f42732478ba732994b2c9e3fbe Apr 13 15:26:18 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1009244781 Apr 13 15:26:18 user devstack@n-api.service[61871]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member Apr 13 15:26:18 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:26:18 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:26:18 user devstack@n-api.service[61871]: X-User-Id: 75bf6e19993f4c2e90fd52c4d6212622 Apr 13 15:26:18 user devstack@n-api.service[61871]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member Apr 13 15:26:18 user devstack@n-api.service[61871]: method: > Apr 13 15:26:18 user devstack@n-api.service[61871]: exception: Instance 149f8be9-79d3-4922-b3cc-c164b8b81534 could not be found. Apr 13 15:26:18 user devstack@n-api.service[61871]: action_args: {'id': '149f8be9-79d3-4922-b3cc-c164b8b81534'} Apr 13 15:26:18 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149f8be9-79d3-4922-b3cc-c164b8b81534 could not be found. Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149f8be9-79d3-4922-b3cc-c164b8b81534 could not be found. Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149f8be9-79d3-4922-b3cc-c164b8b81534 could not be found. Apr 13 15:26:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:26:18 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-94f19b43-470a-4e55-abb7-bd6a2d8bb561 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Returning 404 to user: Instance 149f8be9-79d3-4922-b3cc-c164b8b81534 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:26:18 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-94f19b43-470a-4e55-abb7-bd6a2d8bb561 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/149f8be9-79d3-4922-b3cc-c164b8b81534" status: 404 len: 111 microversion: 2.87 time: 0.037607 Apr 13 15:26:18 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 260/791] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:26:18 2023] GET /compute/v2.1/servers/149f8be9-79d3-4922-b3cc-c164b8b81534 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:26:18 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:18 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:26:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:18 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:18 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Going to try to terminate instance {{(pid=61872) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:26:19 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473" status: 204 len: 0 microversion: 2.87 time: 0.484346 Apr 13 15:26:19 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 267/792] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 15:26:18 2023] DELETE /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 15:26:19 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-8ddbc9c4-3660-49b2-a62a-7e17f0c36e40 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:19 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-8ddbc9c4-3660-49b2-a62a-7e17f0c36e40 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:26:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8ddbc9c4-3660-49b2-a62a-7e17f0c36e40 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8ddbc9c4-3660-49b2-a62a-7e17f0c36e40 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8ddbc9c4-3660-49b2-a62a-7e17f0c36e40 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8ddbc9c4-3660-49b2-a62a-7e17f0c36e40 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8ddbc9c4-3660-49b2-a62a-7e17f0c36e40 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8ddbc9c4-3660-49b2-a62a-7e17f0c36e40 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:19 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-8ddbc9c4-3660-49b2-a62a-7e17f0c36e40 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:26:19 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-8ddbc9c4-3660-49b2-a62a-7e17f0c36e40 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:26:19 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-8ddbc9c4-3660-49b2-a62a-7e17f0c36e40 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:26:19 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-8ddbc9c4-3660-49b2-a62a-7e17f0c36e40 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473" status: 200 len: 1774 microversion: 2.87 time: 0.316659 Apr 13 15:26:19 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 266/793] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:26:19 2023] GET /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473 => generated 1774 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:26:19 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-ad905396-cfcf-4b32-9e1b-f139cd267f23 req-ef164112-3d61-4ba2-80e2-369da246458a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0a9548-9e57-4007-bafb-d418a4433473", "name": "network-vif-unplugged", "status": "completed", "tag": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ad905396-cfcf-4b32-9e1b-f139cd267f23 req-ef164112-3d61-4ba2-80e2-369da246458a service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ad905396-cfcf-4b32-9e1b-f139cd267f23 req-ef164112-3d61-4ba2-80e2-369da246458a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:19 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ad905396-cfcf-4b32-9e1b-f139cd267f23 req-ef164112-3d61-4ba2-80e2-369da246458a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:19 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-ad905396-cfcf-4b32-9e1b-f139cd267f23 req-ef164112-3d61-4ba2-80e2-369da246458a service nova] Creating event network-vif-unplugged:0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance 0a0a9548-9e57-4007-bafb-d418a4433473 on user Apr 13 15:26:19 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-ad905396-cfcf-4b32-9e1b-f139cd267f23 req-ef164112-3d61-4ba2-80e2-369da246458a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051202 Apr 13 15:26:19 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 261/794] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:26:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:26:21 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-3d42bf6d-6e0e-42e8-91fb-9601d493b3cb req-d9984ccc-75a1-45dd-a7a6-4344e82f9442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0a9548-9e57-4007-bafb-d418a4433473", "name": "network-vif-deleted", "tag": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:21 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3d42bf6d-6e0e-42e8-91fb-9601d493b3cb req-d9984ccc-75a1-45dd-a7a6-4344e82f9442 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:21 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3d42bf6d-6e0e-42e8-91fb-9601d493b3cb req-d9984ccc-75a1-45dd-a7a6-4344e82f9442 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:21 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3d42bf6d-6e0e-42e8-91fb-9601d493b3cb req-d9984ccc-75a1-45dd-a7a6-4344e82f9442 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:21 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-3d42bf6d-6e0e-42e8-91fb-9601d493b3cb req-d9984ccc-75a1-45dd-a7a6-4344e82f9442 service nova] Creating event network-vif-deleted:0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance 0a0a9548-9e57-4007-bafb-d418a4433473 on user Apr 13 15:26:21 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-3d42bf6d-6e0e-42e8-91fb-9601d493b3cb req-d9984ccc-75a1-45dd-a7a6-4344e82f9442 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034982 Apr 13 15:26:21 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 268/795] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:26:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:26:21 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-5ee76525-0502-4af2-ad49-435a6e119506 req-bb667d55-67fe-4f4c-a99a-a6cb174d2ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0a9548-9e57-4007-bafb-d418a4433473", "name": "network-vif-plugged", "status": "completed", "tag": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5ee76525-0502-4af2-ad49-435a6e119506 req-bb667d55-67fe-4f4c-a99a-a6cb174d2ae3 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5ee76525-0502-4af2-ad49-435a6e119506 req-bb667d55-67fe-4f4c-a99a-a6cb174d2ae3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5ee76525-0502-4af2-ad49-435a6e119506 req-bb667d55-67fe-4f4c-a99a-a6cb174d2ae3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:21 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-5ee76525-0502-4af2-ad49-435a6e119506 req-bb667d55-67fe-4f4c-a99a-a6cb174d2ae3 service nova] Creating event network-vif-plugged:0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance 0a0a9548-9e57-4007-bafb-d418a4433473 on user Apr 13 15:26:21 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-5ee76525-0502-4af2-ad49-435a6e119506 req-bb667d55-67fe-4f4c-a99a-a6cb174d2ae3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032458 Apr 13 15:26:21 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 267/796] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:26:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:26:23 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-74642e5b-57f2-4507-9562-663a19e4b06f req-f18e45e8-323b-4793-b0e8-1afd59541a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1dcf028-0a0b-4b9d-b654-40f7627ebd36", "tag": "4c0cf892-f8a1-4d12-b359-b2673ecfd984"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-74642e5b-57f2-4507-9562-663a19e4b06f req-f18e45e8-323b-4793-b0e8-1afd59541a02 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-74642e5b-57f2-4507-9562-663a19e4b06f req-f18e45e8-323b-4793-b0e8-1afd59541a02 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-74642e5b-57f2-4507-9562-663a19e4b06f req-f18e45e8-323b-4793-b0e8-1afd59541a02 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:23 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-74642e5b-57f2-4507-9562-663a19e4b06f req-f18e45e8-323b-4793-b0e8-1afd59541a02 service nova] Creating event network-changed:4c0cf892-f8a1-4d12-b359-b2673ecfd984 for instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 on user Apr 13 15:26:23 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-74642e5b-57f2-4507-9562-663a19e4b06f req-f18e45e8-323b-4793-b0e8-1afd59541a02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035232 Apr 13 15:26:23 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 262/797] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:26:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:26:24 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-76b171ef-039e-42eb-8bb5-b6be32106ca9 req-ab5cd529-6774-41fb-9355-2e7938e917cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1dcf028-0a0b-4b9d-b654-40f7627ebd36", "name": "network-vif-plugged", "status": "completed", "tag": "4c0cf892-f8a1-4d12-b359-b2673ecfd984"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-76b171ef-039e-42eb-8bb5-b6be32106ca9 req-ab5cd529-6774-41fb-9355-2e7938e917cc service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-76b171ef-039e-42eb-8bb5-b6be32106ca9 req-ab5cd529-6774-41fb-9355-2e7938e917cc service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-76b171ef-039e-42eb-8bb5-b6be32106ca9 req-ab5cd529-6774-41fb-9355-2e7938e917cc service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:24 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-76b171ef-039e-42eb-8bb5-b6be32106ca9 req-ab5cd529-6774-41fb-9355-2e7938e917cc service nova] Creating event network-vif-plugged:4c0cf892-f8a1-4d12-b359-b2673ecfd984 for instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 on user Apr 13 15:26:24 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-76b171ef-039e-42eb-8bb5-b6be32106ca9 req-ab5cd529-6774-41fb-9355-2e7938e917cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037097 Apr 13 15:26:24 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 269/798] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:26:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:26:26 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-b05567b1-4bdf-45b5-a605-f86922d24ca6 req-033b4b20-b2ac-4b48-8605-cb130447b560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1dcf028-0a0b-4b9d-b654-40f7627ebd36", "name": "network-vif-plugged", "status": "completed", "tag": "4c0cf892-f8a1-4d12-b359-b2673ecfd984"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b05567b1-4bdf-45b5-a605-f86922d24ca6 req-033b4b20-b2ac-4b48-8605-cb130447b560 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b05567b1-4bdf-45b5-a605-f86922d24ca6 req-033b4b20-b2ac-4b48-8605-cb130447b560 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b05567b1-4bdf-45b5-a605-f86922d24ca6 req-033b4b20-b2ac-4b48-8605-cb130447b560 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:26 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-b05567b1-4bdf-45b5-a605-f86922d24ca6 req-033b4b20-b2ac-4b48-8605-cb130447b560 service nova] Creating event network-vif-plugged:4c0cf892-f8a1-4d12-b359-b2673ecfd984 for instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 on user Apr 13 15:26:26 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-b05567b1-4bdf-45b5-a605-f86922d24ca6 req-033b4b20-b2ac-4b48-8605-cb130447b560 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057632 Apr 13 15:26:26 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 268/799] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:26:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=24 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-539053316", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "networks": [{"uuid": "83cf3a37-c06c-4968-b7be-db5b44d56301"}]}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] validate_networks() for [('83cf3a37-c06c-4968-b7be-db5b44d56301', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Getting quotas for project c21b26110ef24c259a7f45913f46d6af. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Getting quotas for user 6fd5e19b47fa493395ca0432e6d85251 and project c21b26110ef24c259a7f45913f46d6af. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:26:49 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:26:49 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.603848 Apr 13 15:26:49 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 263/800] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:26:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:26:49 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:26:49 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:26:49 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:26:49 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-fc709b2e-8253-4fd8-9e0d-f86bba6820a1 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:49 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-fc709b2e-8253-4fd8-9e0d-f86bba6820a1 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:26:50 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-fc709b2e-8253-4fd8-9e0d-f86bba6820a1 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5e19b47fa493395ca0432e6d85251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21b26110ef24c259a7f45913f46d6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:26:50 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-fc709b2e-8253-4fd8-9e0d-f86bba6820a1 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1" status: 200 len: 1207 microversion: 2.1 time: 0.090296 Apr 13 15:26:50 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 270/801] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:26:49 2023] GET /compute/v2.1/servers/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 => generated 1207 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:26:52 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:26:52 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:26:52 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:26:52 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=30 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:26:52 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-c3082b83-9213-43ee-abfd-0da01c19b09f req-d3345aea-5ca9-4535-9b4a-882e97759038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1", "tag": "be7faa0d-9682-48e3-9a50-db4d80d7a54a"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:52 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c3082b83-9213-43ee-abfd-0da01c19b09f req-d3345aea-5ca9-4535-9b4a-882e97759038 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:52 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c3082b83-9213-43ee-abfd-0da01c19b09f req-d3345aea-5ca9-4535-9b4a-882e97759038 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:52 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-c3082b83-9213-43ee-abfd-0da01c19b09f req-d3345aea-5ca9-4535-9b4a-882e97759038 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:52 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-c3082b83-9213-43ee-abfd-0da01c19b09f req-d3345aea-5ca9-4535-9b4a-882e97759038 service nova] Creating event network-changed:be7faa0d-9682-48e3-9a50-db4d80d7a54a for instance 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 on user Apr 13 15:26:52 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-c3082b83-9213-43ee-abfd-0da01c19b09f req-d3345aea-5ca9-4535-9b4a-882e97759038 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036054 Apr 13 15:26:52 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 269/802] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:26:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:26:52 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-136e3958-b1e5-4f04-98a4-7b57d0a78b40 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:52 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-136e3958-b1e5-4f04-98a4-7b57d0a78b40 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:26:52 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-136e3958-b1e5-4f04-98a4-7b57d0a78b40 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:52 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-136e3958-b1e5-4f04-98a4-7b57d0a78b40 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:52 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-136e3958-b1e5-4f04-98a4-7b57d0a78b40 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:52 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-136e3958-b1e5-4f04-98a4-7b57d0a78b40 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:52 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-136e3958-b1e5-4f04-98a4-7b57d0a78b40 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:52 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-136e3958-b1e5-4f04-98a4-7b57d0a78b40 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:52 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-136e3958-b1e5-4f04-98a4-7b57d0a78b40 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:26:52 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-136e3958-b1e5-4f04-98a4-7b57d0a78b40 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58e8e652-d56c-45b6-92ff-a50406ea48e9" status: 200 len: 1538 microversion: 2.1 time: 0.229348 Apr 13 15:26:52 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 264/803] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:26:52 2023] GET /compute/v2.1/servers/58e8e652-d56c-45b6-92ff-a50406ea48e9 => generated 1538 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:26:54 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-13daa239-6623-4b7b-a1a1-5964d23a1f86 req-9a455d2c-f585-4907-a89a-59226b0077bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1", "name": "network-vif-plugged", "status": "completed", "tag": "be7faa0d-9682-48e3-9a50-db4d80d7a54a"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-13daa239-6623-4b7b-a1a1-5964d23a1f86 req-9a455d2c-f585-4907-a89a-59226b0077bb service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-13daa239-6623-4b7b-a1a1-5964d23a1f86 req-9a455d2c-f585-4907-a89a-59226b0077bb service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-13daa239-6623-4b7b-a1a1-5964d23a1f86 req-9a455d2c-f585-4907-a89a-59226b0077bb service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:54 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-13daa239-6623-4b7b-a1a1-5964d23a1f86 req-9a455d2c-f585-4907-a89a-59226b0077bb service nova] Creating event network-vif-plugged:be7faa0d-9682-48e3-9a50-db4d80d7a54a for instance 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 on user Apr 13 15:26:54 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-13daa239-6623-4b7b-a1a1-5964d23a1f86 req-9a455d2c-f585-4907-a89a-59226b0077bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035969 Apr 13 15:26:54 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 271/804] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:26:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:26:56 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-0b4533e9-eb04-4da6-889e-1c12d6841964 req-f1f68b09-9c3c-4eba-8a08-60da105a86a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1", "name": "network-vif-plugged", "status": "completed", "tag": "be7faa0d-9682-48e3-9a50-db4d80d7a54a"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:26:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-0b4533e9-eb04-4da6-889e-1c12d6841964 req-f1f68b09-9c3c-4eba-8a08-60da105a86a0 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-0b4533e9-eb04-4da6-889e-1c12d6841964 req-f1f68b09-9c3c-4eba-8a08-60da105a86a0 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-0b4533e9-eb04-4da6-889e-1c12d6841964 req-f1f68b09-9c3c-4eba-8a08-60da105a86a0 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:56 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-0b4533e9-eb04-4da6-889e-1c12d6841964 req-f1f68b09-9c3c-4eba-8a08-60da105a86a0 service nova] Creating event network-vif-plugged:be7faa0d-9682-48e3-9a50-db4d80d7a54a for instance 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 on user Apr 13 15:26:56 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-0b4533e9-eb04-4da6-889e-1c12d6841964 req-f1f68b09-9c3c-4eba-8a08-60da105a86a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028835 Apr 13 15:26:56 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 270/805] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:26:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:26:58 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-3bdeec86-e4da-4007-bbe6-d602235dc351 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:26:58 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-3bdeec86-e4da-4007-bbe6-d602235dc351 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:26:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-3bdeec86-e4da-4007-bbe6-d602235dc351 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-3bdeec86-e4da-4007-bbe6-d602235dc351 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-3bdeec86-e4da-4007-bbe6-d602235dc351 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-3bdeec86-e4da-4007-bbe6-d602235dc351 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:26:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-3bdeec86-e4da-4007-bbe6-d602235dc351 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:26:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-3bdeec86-e4da-4007-bbe6-d602235dc351 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:26:58 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-3bdeec86-e4da-4007-bbe6-d602235dc351 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e289648c244c77ab9ca48154da3cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318b9e0eb6a745df811d1daa4d6195fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:26:58 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-3bdeec86-e4da-4007-bbe6-d602235dc351 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0" status: 200 len: 1538 microversion: 2.1 time: 0.148223 Apr 13 15:26:58 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 265/806] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:26:58 2023] GET /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0 => generated 1538 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 15:27:08 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:08 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:08 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:08 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-b1c2f847-1fb7-44c8-8bdf-ae5a34d14aa5 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:27:08 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-b1c2f847-1fb7-44c8-8bdf-ae5a34d14aa5 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:27:08 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b1c2f847-1fb7-44c8-8bdf-ae5a34d14aa5 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:08 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b1c2f847-1fb7-44c8-8bdf-ae5a34d14aa5 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:08 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b1c2f847-1fb7-44c8-8bdf-ae5a34d14aa5 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:08 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b1c2f847-1fb7-44c8-8bdf-ae5a34d14aa5 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:08 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b1c2f847-1fb7-44c8-8bdf-ae5a34d14aa5 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:08 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b1c2f847-1fb7-44c8-8bdf-ae5a34d14aa5 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:08 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-b1c2f847-1fb7-44c8-8bdf-ae5a34d14aa5 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedd34ccc15c47f9a4fc96b080730acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3ba2d132c445039d0ae30ffd2bc64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:27:08 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-b1c2f847-1fb7-44c8-8bdf-ae5a34d14aa5 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36" status: 200 len: 1543 microversion: 2.1 time: 0.254095 Apr 13 15:27:08 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 272/807] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:27:08 2023] GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36 => generated 1543 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:27:09 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:09 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:09 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-57ae652b-7d4f-4bf9-bc35-3d93af7c32bb tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:27:09 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-57ae652b-7d4f-4bf9-bc35-3d93af7c32bb tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:27:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-57ae652b-7d4f-4bf9-bc35-3d93af7c32bb tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-57ae652b-7d4f-4bf9-bc35-3d93af7c32bb tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-57ae652b-7d4f-4bf9-bc35-3d93af7c32bb tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-57ae652b-7d4f-4bf9-bc35-3d93af7c32bb tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-57ae652b-7d4f-4bf9-bc35-3d93af7c32bb tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-57ae652b-7d4f-4bf9-bc35-3d93af7c32bb tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:09 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-57ae652b-7d4f-4bf9-bc35-3d93af7c32bb tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] HTTP exception thrown: Instance 0a0a9548-9e57-4007-bafb-d418a4433473 could not be found. Apr 13 15:27:09 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-57ae652b-7d4f-4bf9-bc35-3d93af7c32bb tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Request method failure captured: Apr 13 15:27:09 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473 HTTP/1.1 Apr 13 15:27:09 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:27:09 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:27:09 user devstack@n-api.service[61873]: Connection: close Apr 13 15:27:09 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:27:09 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:27:09 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:27:09 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:27:09 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:27:09 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBq0G06yy_S0S-CbKNk_aJgmQk-1S845U9g-GbAd_dowTuItPmG6TAi6xeljGQ3NDYEU_gQTLkfEb5D0nrDi6EYOMoLCCKW4BhYYN-wmrZax_yeJDN3FdNMU-aPzV4v7tc9FIc0V-2OA1-LDIpzzHgahgDhvIMQD4Jd2vaRpj2ax6ok Apr 13 15:27:09 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:27:09 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:27:09 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:27:09 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:27:09 user devstack@n-api.service[61873]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 15:27:09 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:27:09 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:27:09 user devstack@n-api.service[61873]: X-Project-Id: 240b28f42732478ba732994b2c9e3fbe Apr 13 15:27:09 user devstack@n-api.service[61873]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1009244781 Apr 13 15:27:09 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:27:09 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:27:09 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/240b28f42732478ba732994b2c9e3fbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/240b28f42732478ba732994b2c9e3fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/240b28f42732478ba732994b2c9e3fbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:27:09 user devstack@n-api.service[61873]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1009244781 Apr 13 15:27:09 user devstack@n-api.service[61873]: X-Tenant-Id: 240b28f42732478ba732994b2c9e3fbe Apr 13 15:27:09 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1009244781 Apr 13 15:27:09 user devstack@n-api.service[61873]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member Apr 13 15:27:09 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:27:09 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:27:09 user devstack@n-api.service[61873]: X-User-Id: 75bf6e19993f4c2e90fd52c4d6212622 Apr 13 15:27:09 user devstack@n-api.service[61873]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member Apr 13 15:27:09 user devstack@n-api.service[61873]: method: > Apr 13 15:27:09 user devstack@n-api.service[61873]: exception: Instance 0a0a9548-9e57-4007-bafb-d418a4433473 could not be found. Apr 13 15:27:09 user devstack@n-api.service[61873]: action_args: {'id': '0a0a9548-9e57-4007-bafb-d418a4433473'} Apr 13 15:27:09 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a0a9548-9e57-4007-bafb-d418a4433473 could not be found. Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a0a9548-9e57-4007-bafb-d418a4433473 could not be found. Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a0a9548-9e57-4007-bafb-d418a4433473 could not be found. Apr 13 15:27:09 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:27:09 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-57ae652b-7d4f-4bf9-bc35-3d93af7c32bb tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Returning 404 to user: Instance 0a0a9548-9e57-4007-bafb-d418a4433473 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:27:09 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-57ae652b-7d4f-4bf9-bc35-3d93af7c32bb tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473" status: 404 len: 111 microversion: 2.87 time: 0.034069 Apr 13 15:27:09 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 271/808] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:27:09 2023] GET /compute/v2.1/servers/0a0a9548-9e57-4007-bafb-d418a4433473 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:27:09 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:27:09 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:27:09 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:09 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:09 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:09 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=14 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:09 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Going to try to terminate instance {{(pid=61871) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:27:09 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" status: 204 len: 0 microversion: 2.87 time: 0.113111 Apr 13 15:27:09 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 266/809] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 15:27:09 2023] DELETE /compute/v2.1/servers/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 15:27:09 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-508ef4b1-4f14-4ce7-a0b7-97b9b1ca3446 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:27:09 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-508ef4b1-4f14-4ce7-a0b7-97b9b1ca3446 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:27:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-508ef4b1-4f14-4ce7-a0b7-97b9b1ca3446 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-508ef4b1-4f14-4ce7-a0b7-97b9b1ca3446 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-508ef4b1-4f14-4ce7-a0b7-97b9b1ca3446 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-508ef4b1-4f14-4ce7-a0b7-97b9b1ca3446 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-508ef4b1-4f14-4ce7-a0b7-97b9b1ca3446 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-508ef4b1-4f14-4ce7-a0b7-97b9b1ca3446 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:10 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-b0068bbc-ffa0-4f10-a627-34e6153676ce req-c9c81f29-58f1-4673-944f-ecf31341d7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba", "name": "network-vif-unplugged", "status": "completed", "tag": "e2b989b1-9194-48e5-a3e4-e35566440e3d"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:27:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b0068bbc-ffa0-4f10-a627-34e6153676ce req-c9c81f29-58f1-4673-944f-ecf31341d7a0 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b0068bbc-ffa0-4f10-a627-34e6153676ce req-c9c81f29-58f1-4673-944f-ecf31341d7a0 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-b0068bbc-ffa0-4f10-a627-34e6153676ce req-c9c81f29-58f1-4673-944f-ecf31341d7a0 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:10 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-b0068bbc-ffa0-4f10-a627-34e6153676ce req-c9c81f29-58f1-4673-944f-ecf31341d7a0 service nova] Creating event network-vif-unplugged:e2b989b1-9194-48e5-a3e4-e35566440e3d for instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba on user Apr 13 15:27:10 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-b0068bbc-ffa0-4f10-a627-34e6153676ce req-c9c81f29-58f1-4673-944f-ecf31341d7a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029466 Apr 13 15:27:10 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 272/810] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:27:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:27:10 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-508ef4b1-4f14-4ce7-a0b7-97b9b1ca3446 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:27:10 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-508ef4b1-4f14-4ce7-a0b7-97b9b1ca3446 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:27:10 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-508ef4b1-4f14-4ce7-a0b7-97b9b1ca3446 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:27:10 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-508ef4b1-4f14-4ce7-a0b7-97b9b1ca3446 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" status: 200 len: 1696 microversion: 2.87 time: 0.584870 Apr 13 15:27:10 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 273/811] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:27:09 2023] GET /compute/v2.1/servers/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba => generated 1696 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:27:11 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-fdd1bb84-b7b0-4913-b319-ead7689d7b16 req-e39b9a93-6c8c-4090-ae18-a6811c5c5309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba", "name": "network-vif-deleted", "tag": "e2b989b1-9194-48e5-a3e4-e35566440e3d"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:27:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-fdd1bb84-b7b0-4913-b319-ead7689d7b16 req-e39b9a93-6c8c-4090-ae18-a6811c5c5309 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-fdd1bb84-b7b0-4913-b319-ead7689d7b16 req-e39b9a93-6c8c-4090-ae18-a6811c5c5309 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-fdd1bb84-b7b0-4913-b319-ead7689d7b16 req-e39b9a93-6c8c-4090-ae18-a6811c5c5309 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:11 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-fdd1bb84-b7b0-4913-b319-ead7689d7b16 req-e39b9a93-6c8c-4090-ae18-a6811c5c5309 service nova] Creating event network-vif-deleted:e2b989b1-9194-48e5-a3e4-e35566440e3d for instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba on user Apr 13 15:27:11 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-fdd1bb84-b7b0-4913-b319-ead7689d7b16 req-e39b9a93-6c8c-4090-ae18-a6811c5c5309 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030846 Apr 13 15:27:11 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 267/812] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:27:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:27:12 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-3f99e2d8-b809-481c-ada9-dce5b7227c43 req-d63182e1-fdeb-41a1-800d-81a974ee7637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba", "name": "network-vif-plugged", "status": "completed", "tag": "e2b989b1-9194-48e5-a3e4-e35566440e3d"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:27:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3f99e2d8-b809-481c-ada9-dce5b7227c43 req-d63182e1-fdeb-41a1-800d-81a974ee7637 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3f99e2d8-b809-481c-ada9-dce5b7227c43 req-d63182e1-fdeb-41a1-800d-81a974ee7637 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3f99e2d8-b809-481c-ada9-dce5b7227c43 req-d63182e1-fdeb-41a1-800d-81a974ee7637 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:12 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-3f99e2d8-b809-481c-ada9-dce5b7227c43 req-d63182e1-fdeb-41a1-800d-81a974ee7637 service nova] Creating event network-vif-plugged:e2b989b1-9194-48e5-a3e4-e35566440e3d for instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba on user Apr 13 15:27:12 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-3f99e2d8-b809-481c-ada9-dce5b7227c43 req-d63182e1-fdeb-41a1-800d-81a974ee7637 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028732 Apr 13 15:27:12 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 273/813] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:27:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:27:16 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-504850890", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "networks": [{"uuid": "8c2be808-8e48-40ed-8182-2243a199bf06"}]}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:27:16 user devstack@n-api.service[61872]: DEBUG nova.network.neutron [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] validate_networks() for [('8c2be808-8e48-40ed-8182-2243a199bf06', None, None, None, None, None)] {{(pid=61872) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:27:16 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Flavor limits 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:27:16 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Image limits 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:27:16 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Flavor pref 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:27:16 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Image pref 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:27:16 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:27:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:16 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Getting quotas for project 1ac07b9454744832b26bf6bd126763ec. Resources: {'cores', 'instances', 'ram'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:27:16 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Getting quotas for user 3a6955546e4f4292a25acad709d27953 and project 1ac07b9454744832b26bf6bd126763ec. Resources: {'cores', 'instances', 'ram'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:27:16 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Going to run 1 instances... {{(pid=61872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:27:16 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:27:16 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.547137 Apr 13 15:27:16 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 274/814] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:27:16 2023] POST /compute/v2.1/servers => generated 378 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:27:16 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-2b9dccf5-0078-4798-ac24-8007b5742198 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:27:16 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-2b9dccf5-0078-4798-ac24-8007b5742198 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:27:16 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-2b9dccf5-0078-4798-ac24-8007b5742198 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6955546e4f4292a25acad709d27953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac07b9454744832b26bf6bd126763ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:27:16 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-2b9dccf5-0078-4798-ac24-8007b5742198 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b" status: 200 len: 1210 microversion: 2.1 time: 0.084828 Apr 13 15:27:16 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 268/815] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:27:16 2023] GET /compute/v2.1/servers/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:27:19 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-d92b66cd-182a-44b1-b229-9dd929e81502 req-5e79c735-5652-4c6d-a1df-518e14f3f29d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b", "tag": "d8276bf9-698e-4940-bace-2aee0c73f7d8"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:27:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d92b66cd-182a-44b1-b229-9dd929e81502 req-5e79c735-5652-4c6d-a1df-518e14f3f29d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d92b66cd-182a-44b1-b229-9dd929e81502 req-5e79c735-5652-4c6d-a1df-518e14f3f29d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d92b66cd-182a-44b1-b229-9dd929e81502 req-5e79c735-5652-4c6d-a1df-518e14f3f29d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:19 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-d92b66cd-182a-44b1-b229-9dd929e81502 req-5e79c735-5652-4c6d-a1df-518e14f3f29d service nova] Creating event network-changed:d8276bf9-698e-4940-bace-2aee0c73f7d8 for instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b on user Apr 13 15:27:19 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-d92b66cd-182a-44b1-b229-9dd929e81502 req-5e79c735-5652-4c6d-a1df-518e14f3f29d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030543 Apr 13 15:27:19 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 274/816] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:27:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:27:21 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-b3f99be4-8b0d-4b12-8cd4-0430fd99c85d req-844a07b4-cb0c-49a1-b7c6-2060ade91b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b", "name": "network-vif-plugged", "status": "completed", "tag": "d8276bf9-698e-4940-bace-2aee0c73f7d8"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:27:21 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-b3f99be4-8b0d-4b12-8cd4-0430fd99c85d req-844a07b4-cb0c-49a1-b7c6-2060ade91b64 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:21 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-b3f99be4-8b0d-4b12-8cd4-0430fd99c85d req-844a07b4-cb0c-49a1-b7c6-2060ade91b64 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:21 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-b3f99be4-8b0d-4b12-8cd4-0430fd99c85d req-844a07b4-cb0c-49a1-b7c6-2060ade91b64 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:21 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-b3f99be4-8b0d-4b12-8cd4-0430fd99c85d req-844a07b4-cb0c-49a1-b7c6-2060ade91b64 service nova] Creating event network-vif-plugged:d8276bf9-698e-4940-bace-2aee0c73f7d8 for instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b on user Apr 13 15:27:21 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-b3f99be4-8b0d-4b12-8cd4-0430fd99c85d req-844a07b4-cb0c-49a1-b7c6-2060ade91b64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030958 Apr 13 15:27:21 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 275/817] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:27:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:27:23 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-883ddfb9-576d-4b34-b31f-23bf49abe1b9 req-42268e98-40e0-4a06-9147-1f4752208957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b", "name": "network-vif-plugged", "status": "completed", "tag": "d8276bf9-698e-4940-bace-2aee0c73f7d8"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:27:23 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-883ddfb9-576d-4b34-b31f-23bf49abe1b9 req-42268e98-40e0-4a06-9147-1f4752208957 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-883ddfb9-576d-4b34-b31f-23bf49abe1b9 req-42268e98-40e0-4a06-9147-1f4752208957 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-883ddfb9-576d-4b34-b31f-23bf49abe1b9 req-42268e98-40e0-4a06-9147-1f4752208957 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:23 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-883ddfb9-576d-4b34-b31f-23bf49abe1b9 req-42268e98-40e0-4a06-9147-1f4752208957 service nova] Creating event network-vif-plugged:d8276bf9-698e-4940-bace-2aee0c73f7d8 for instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b on user Apr 13 15:27:23 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-883ddfb9-576d-4b34-b31f-23bf49abe1b9 req-42268e98-40e0-4a06-9147-1f4752208957 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050432 Apr 13 15:27:23 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 269/818] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:27:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:27:40 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=8 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:40 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=8 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:40 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-42bfeddc-abf2-441a-ab0d-8decce97a866 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:27:40 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-42bfeddc-abf2-441a-ab0d-8decce97a866 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:27:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-42bfeddc-abf2-441a-ab0d-8decce97a866 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-42bfeddc-abf2-441a-ab0d-8decce97a866 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-42bfeddc-abf2-441a-ab0d-8decce97a866 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-42bfeddc-abf2-441a-ab0d-8decce97a866 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-42bfeddc-abf2-441a-ab0d-8decce97a866 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-42bfeddc-abf2-441a-ab0d-8decce97a866 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:40 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-42bfeddc-abf2-441a-ab0d-8decce97a866 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5e19b47fa493395ca0432e6d85251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21b26110ef24c259a7f45913f46d6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:27:40 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-42bfeddc-abf2-441a-ab0d-8decce97a866 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1" status: 200 len: 1486 microversion: 2.1 time: 0.258456 Apr 13 15:27:40 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 275/819] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:27:40 2023] GET /compute/v2.1/servers/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 => generated 1486 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:27:52 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:52 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:52 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:52 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=16 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:53 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-328fcc50-f6ee-475d-a77f-0f32c8e53924 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:27:53 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-328fcc50-f6ee-475d-a77f-0f32c8e53924 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:27:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-328fcc50-f6ee-475d-a77f-0f32c8e53924 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-328fcc50-f6ee-475d-a77f-0f32c8e53924 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-328fcc50-f6ee-475d-a77f-0f32c8e53924 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-328fcc50-f6ee-475d-a77f-0f32c8e53924 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-328fcc50-f6ee-475d-a77f-0f32c8e53924 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:53 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-328fcc50-f6ee-475d-a77f-0f32c8e53924 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:53 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-328fcc50-f6ee-475d-a77f-0f32c8e53924 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58e8e652-d56c-45b6-92ff-a50406ea48e9/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.271837 Apr 13 15:27:53 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 276/820] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 15:27:52 2023] GET /compute/v2.1/servers/58e8e652-d56c-45b6-92ff-a50406ea48e9/os-interface => generated 283 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:27:54 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:54 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:54 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-c995056a-ab87-43a5-8591-1d12dbb594bb req-21fc25ca-108d-4c93-9564-77dc95f2f8ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e8e652-d56c-45b6-92ff-a50406ea48e9", "tag": "018bebd6-4323-4f9d-8c6d-6da9a7934a97"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:27:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c995056a-ab87-43a5-8591-1d12dbb594bb req-21fc25ca-108d-4c93-9564-77dc95f2f8ec service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c995056a-ab87-43a5-8591-1d12dbb594bb req-21fc25ca-108d-4c93-9564-77dc95f2f8ec service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c995056a-ab87-43a5-8591-1d12dbb594bb req-21fc25ca-108d-4c93-9564-77dc95f2f8ec service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:54 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-c995056a-ab87-43a5-8591-1d12dbb594bb req-21fc25ca-108d-4c93-9564-77dc95f2f8ec service nova] Creating event network-changed:018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 on user Apr 13 15:27:54 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-c995056a-ab87-43a5-8591-1d12dbb594bb req-21fc25ca-108d-4c93-9564-77dc95f2f8ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034953 Apr 13 15:27:54 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 270/821] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:27:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:27:57 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:57 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:27:57 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-243297081", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "4ed78a75-b065-400b-8eb2-71085d406a1e"}], "security_groups": [{"name": "tempest-securitygroup--1561728944"}], "key_name": "tempest-keypair-164816521", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "3ec0bd78-5754-47ac-8a42-bbdd51d2d002", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:27:57 user devstack@n-api.service[61873]: DEBUG nova.network.neutron [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] validate_networks() for [('4ed78a75-b065-400b-8eb2-71085d406a1e', None, None, None, None, None)] {{(pid=61873) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:27:57 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:27:57 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:27:57 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:27:57 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:27:57 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:27:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:57 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting quotas for project 9154e4239a1a42a3820c27563ba0513f. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:27:57 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting quotas for user 3c12c62d4137473596571e523163e718 and project 9154e4239a1a42a3820c27563ba0513f. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:27:57 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Going to run 1 instances... {{(pid=61873) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:27:57 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3ec0bd78-5754-47ac-8a42-bbdd51d2d002',volume_size=None,volume_type=None)] {{(pid=61873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:27:57 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.706360 Apr 13 15:27:57 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 276/822] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:27:57 2023] POST /compute/v2.1/servers => generated 404 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:27:57 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-f3d9098d-85a6-4bc0-b77e-449e3024c38a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:27:57 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-f3d9098d-85a6-4bc0-b77e-449e3024c38a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:27:58 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-f3d9098d-85a6-4bc0-b77e-449e3024c38a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:27:58 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-f3d9098d-85a6-4bc0-b77e-449e3024c38a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643" status: 200 len: 1074 microversion: 2.1 time: 0.068571 Apr 13 15:27:58 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 277/823] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:27:57 2023] GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643 => generated 1074 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:27:58 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-f9f992af-7294-4abc-bae6-a9b1baa7f77d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:27:58 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-f9f992af-7294-4abc-bae6-a9b1baa7f77d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:27:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f9f992af-7294-4abc-bae6-a9b1baa7f77d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f9f992af-7294-4abc-bae6-a9b1baa7f77d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f9f992af-7294-4abc-bae6-a9b1baa7f77d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f9f992af-7294-4abc-bae6-a9b1baa7f77d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:27:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f9f992af-7294-4abc-bae6-a9b1baa7f77d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:27:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f9f992af-7294-4abc-bae6-a9b1baa7f77d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:27:58 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-f9f992af-7294-4abc-bae6-a9b1baa7f77d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e289648c244c77ab9ca48154da3cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318b9e0eb6a745df811d1daa4d6195fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:27:58 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-f9f992af-7294-4abc-bae6-a9b1baa7f77d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0" status: 200 len: 1538 microversion: 2.1 time: 0.197145 Apr 13 15:27:58 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 271/824] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:27:58 2023] GET /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0 => generated 1538 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:28:00 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-a575afbb-2128-4431-8ff9-21077dfc2cc0 req-50707190-3f03-46f9-bf86-21c439be558c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed13cfeb-933e-4cff-804a-f7404df7f2b0", "tag": "f72dcc71-6349-4489-8605-18cb581b5750"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:28:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-a575afbb-2128-4431-8ff9-21077dfc2cc0 req-50707190-3f03-46f9-bf86-21c439be558c service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-a575afbb-2128-4431-8ff9-21077dfc2cc0 req-50707190-3f03-46f9-bf86-21c439be558c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-a575afbb-2128-4431-8ff9-21077dfc2cc0 req-50707190-3f03-46f9-bf86-21c439be558c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:00 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-a575afbb-2128-4431-8ff9-21077dfc2cc0 req-50707190-3f03-46f9-bf86-21c439be558c service nova] Creating event network-changed:f72dcc71-6349-4489-8605-18cb581b5750 for instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 on user Apr 13 15:28:00 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-a575afbb-2128-4431-8ff9-21077dfc2cc0 req-50707190-3f03-46f9-bf86-21c439be558c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095529 Apr 13 15:28:00 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 277/825] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:28:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:28:00 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc8b0061-9677-4611-93cf-b64d28575c63"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:28:00 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:28:00 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:00 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:00 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:00 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:00 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:00 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:00 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-f918398f-d5ca-4656-a9ad-ca45f4f68721 req-348df57c-24cd-4071-9f52-6b24d44faa0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4211d816-b8aa-452e-9587-bf131e42d643", "tag": "e42a12d0-d042-4277-83a6-7141c1df1ea2"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:28:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-f918398f-d5ca-4656-a9ad-ca45f4f68721 req-348df57c-24cd-4071-9f52-6b24d44faa0c service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-f918398f-d5ca-4656-a9ad-ca45f4f68721 req-348df57c-24cd-4071-9f52-6b24d44faa0c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-f918398f-d5ca-4656-a9ad-ca45f4f68721 req-348df57c-24cd-4071-9f52-6b24d44faa0c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:00 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-e49726fb-56c0-4faf-8e0a-82932a366a3d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:28:00 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-e49726fb-56c0-4faf-8e0a-82932a366a3d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:28:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e49726fb-56c0-4faf-8e0a-82932a366a3d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e49726fb-56c0-4faf-8e0a-82932a366a3d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e49726fb-56c0-4faf-8e0a-82932a366a3d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:00 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-f918398f-d5ca-4656-a9ad-ca45f4f68721 req-348df57c-24cd-4071-9f52-6b24d44faa0c service nova] Creating event network-changed:e42a12d0-d042-4277-83a6-7141c1df1ea2 for instance 4211d816-b8aa-452e-9587-bf131e42d643 on user Apr 13 15:28:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e49726fb-56c0-4faf-8e0a-82932a366a3d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e49726fb-56c0-4faf-8e0a-82932a366a3d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e49726fb-56c0-4faf-8e0a-82932a366a3d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:00 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-f918398f-d5ca-4656-a9ad-ca45f4f68721 req-348df57c-24cd-4071-9f52-6b24d44faa0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036670 Apr 13 15:28:00 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 272/826] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:28:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:28:00 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-e49726fb-56c0-4faf-8e0a-82932a366a3d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] HTTP exception thrown: Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba could not be found. Apr 13 15:28:00 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-e49726fb-56c0-4faf-8e0a-82932a366a3d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Request method failure captured: Apr 13 15:28:00 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba HTTP/1.1 Apr 13 15:28:00 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:28:00 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:28:00 user devstack@n-api.service[61873]: Connection: close Apr 13 15:28:00 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:28:00 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:28:00 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:28:00 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:28:00 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:28:00 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBq0G06yy_S0S-CbKNk_aJgmQk-1S845U9g-GbAd_dowTuItPmG6TAi6xeljGQ3NDYEU_gQTLkfEb5D0nrDi6EYOMoLCCKW4BhYYN-wmrZax_yeJDN3FdNMU-aPzV4v7tc9FIc0V-2OA1-LDIpzzHgahgDhvIMQD4Jd2vaRpj2ax6ok Apr 13 15:28:00 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:28:00 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:28:00 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:28:00 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:28:00 user devstack@n-api.service[61873]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 15:28:00 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:28:00 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:28:00 user devstack@n-api.service[61873]: X-Project-Id: 240b28f42732478ba732994b2c9e3fbe Apr 13 15:28:00 user devstack@n-api.service[61873]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1009244781 Apr 13 15:28:00 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:28:00 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:28:00 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/240b28f42732478ba732994b2c9e3fbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/240b28f42732478ba732994b2c9e3fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/240b28f42732478ba732994b2c9e3fbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:28:00 user devstack@n-api.service[61873]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1009244781 Apr 13 15:28:00 user devstack@n-api.service[61873]: X-Tenant-Id: 240b28f42732478ba732994b2c9e3fbe Apr 13 15:28:00 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1009244781 Apr 13 15:28:00 user devstack@n-api.service[61873]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member Apr 13 15:28:00 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:28:00 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:28:00 user devstack@n-api.service[61873]: X-User-Id: 75bf6e19993f4c2e90fd52c4d6212622 Apr 13 15:28:00 user devstack@n-api.service[61873]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member Apr 13 15:28:00 user devstack@n-api.service[61873]: method: > Apr 13 15:28:00 user devstack@n-api.service[61873]: exception: Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba could not be found. Apr 13 15:28:00 user devstack@n-api.service[61873]: action_args: {'id': '37ff2115-ebfa-4cd2-b52f-89e354f0f5ba'} Apr 13 15:28:00 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba could not be found. Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba could not be found. Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba could not be found. Apr 13 15:28:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:28:00 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-e49726fb-56c0-4faf-8e0a-82932a366a3d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Returning 404 to user: Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:28:00 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-e49726fb-56c0-4faf-8e0a-82932a366a3d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" status: 404 len: 111 microversion: 2.87 time: 0.035427 Apr 13 15:28:00 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 278/827] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:28:00 2023] GET /compute/v2.1/servers/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:28:00 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.479349 Apr 13 15:28:00 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 278/828] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:28:00 2023] POST /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0/os-volume_attachments => generated 194 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:28:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-c83eff12-e893-403e-a8ee-6d2a7cde76dc req-73eddbc7-05db-4e37-bfd2-472c07aceb0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4211d816-b8aa-452e-9587-bf131e42d643", "name": "network-vif-plugged", "status": "completed", "tag": "e42a12d0-d042-4277-83a6-7141c1df1ea2"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:28:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c83eff12-e893-403e-a8ee-6d2a7cde76dc req-73eddbc7-05db-4e37-bfd2-472c07aceb0c service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c83eff12-e893-403e-a8ee-6d2a7cde76dc req-73eddbc7-05db-4e37-bfd2-472c07aceb0c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c83eff12-e893-403e-a8ee-6d2a7cde76dc req-73eddbc7-05db-4e37-bfd2-472c07aceb0c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:06 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-c83eff12-e893-403e-a8ee-6d2a7cde76dc req-73eddbc7-05db-4e37-bfd2-472c07aceb0c service nova] Creating event network-vif-plugged:e42a12d0-d042-4277-83a6-7141c1df1ea2 for instance 4211d816-b8aa-452e-9587-bf131e42d643 on user Apr 13 15:28:06 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-c83eff12-e893-403e-a8ee-6d2a7cde76dc req-73eddbc7-05db-4e37-bfd2-472c07aceb0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028114 Apr 13 15:28:06 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 273/829] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:28:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:28:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-21f661d2-bd9d-4516-950c-81bba09fa2dd tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:28:06 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-21f661d2-bd9d-4516-950c-81bba09fa2dd tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:28:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-21f661d2-bd9d-4516-950c-81bba09fa2dd tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-21f661d2-bd9d-4516-950c-81bba09fa2dd tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-21f661d2-bd9d-4516-950c-81bba09fa2dd tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-21f661d2-bd9d-4516-950c-81bba09fa2dd tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-21f661d2-bd9d-4516-950c-81bba09fa2dd tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-21f661d2-bd9d-4516-950c-81bba09fa2dd tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:06 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-21f661d2-bd9d-4516-950c-81bba09fa2dd tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6955546e4f4292a25acad709d27953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac07b9454744832b26bf6bd126763ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:28:06 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-21f661d2-bd9d-4516-950c-81bba09fa2dd tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b" status: 200 len: 1493 microversion: 2.1 time: 0.170704 Apr 13 15:28:06 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 279/830] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:28:06 2023] GET /compute/v2.1/servers/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b => generated 1493 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:28:08 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:28:08 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-3c5f9d8e-9f81-4056-ab66-897c5e3f2c0f req-15c9db73-709f-48e0-a009-82474c8c22a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4211d816-b8aa-452e-9587-bf131e42d643", "name": "network-vif-plugged", "status": "completed", "tag": "e42a12d0-d042-4277-83a6-7141c1df1ea2"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:28:08 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3c5f9d8e-9f81-4056-ab66-897c5e3f2c0f req-15c9db73-709f-48e0-a009-82474c8c22a9 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:08 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3c5f9d8e-9f81-4056-ab66-897c5e3f2c0f req-15c9db73-709f-48e0-a009-82474c8c22a9 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:08 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3c5f9d8e-9f81-4056-ab66-897c5e3f2c0f req-15c9db73-709f-48e0-a009-82474c8c22a9 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:08 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-3c5f9d8e-9f81-4056-ab66-897c5e3f2c0f req-15c9db73-709f-48e0-a009-82474c8c22a9 service nova] Creating event network-vif-plugged:e42a12d0-d042-4277-83a6-7141c1df1ea2 for instance 4211d816-b8aa-452e-9587-bf131e42d643 on user Apr 13 15:28:08 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-3c5f9d8e-9f81-4056-ab66-897c5e3f2c0f req-15c9db73-709f-48e0-a009-82474c8c22a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034163 Apr 13 15:28:08 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 279/831] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:28:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:28:08 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-db07def9-f8f2-4334-94a7-406a6b2cb539 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:28:08 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-db07def9-f8f2-4334-94a7-406a6b2cb539 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:28:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-db07def9-f8f2-4334-94a7-406a6b2cb539 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-db07def9-f8f2-4334-94a7-406a6b2cb539 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-db07def9-f8f2-4334-94a7-406a6b2cb539 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-db07def9-f8f2-4334-94a7-406a6b2cb539 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-db07def9-f8f2-4334-94a7-406a6b2cb539 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-db07def9-f8f2-4334-94a7-406a6b2cb539 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:08 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:28:08 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:28:08 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:28:08 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:28:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:09 user devstack@n-api.service[61873]: DEBUG nova.objects.instance [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lazy-loading 'services' on Instance uuid ed13cfeb-933e-4cff-804a-f7404df7f2b0 {{(pid=61873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:28:09 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-db07def9-f8f2-4334-94a7-406a6b2cb539 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.255839 Apr 13 15:28:09 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 274/832] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 15:28:08 2023] GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/os-interface => generated 283 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:28:09 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0/os-volume_attachments/cc8b0061-9677-4611-93cf-b64d28575c63" status: 202 len: 0 microversion: 2.1 time: 0.196290 Apr 13 15:28:09 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 280/833] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:28:08 2023] DELETE /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0/os-volume_attachments/cc8b0061-9677-4611-93cf-b64d28575c63 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:28:09 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-8d12bc29-fa92-4332-90ba-d54cf51fd41c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:28:09 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-8d12bc29-fa92-4332-90ba-d54cf51fd41c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:28:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8d12bc29-fa92-4332-90ba-d54cf51fd41c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8d12bc29-fa92-4332-90ba-d54cf51fd41c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8d12bc29-fa92-4332-90ba-d54cf51fd41c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8d12bc29-fa92-4332-90ba-d54cf51fd41c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8d12bc29-fa92-4332-90ba-d54cf51fd41c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-8d12bc29-fa92-4332-90ba-d54cf51fd41c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:09 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-8d12bc29-fa92-4332-90ba-d54cf51fd41c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055449 Apr 13 15:28:09 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 280/834] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:28:09 2023] GET /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:28:10 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-cc2cfff3-c19d-424b-a0e9-423f0981c76f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:28:10 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-cc2cfff3-c19d-424b-a0e9-423f0981c76f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:28:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cc2cfff3-c19d-424b-a0e9-423f0981c76f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cc2cfff3-c19d-424b-a0e9-423f0981c76f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cc2cfff3-c19d-424b-a0e9-423f0981c76f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cc2cfff3-c19d-424b-a0e9-423f0981c76f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cc2cfff3-c19d-424b-a0e9-423f0981c76f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cc2cfff3-c19d-424b-a0e9-423f0981c76f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:10 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-c633bce6-24e1-450d-bcfe-b396f2bfdff2 req-bdaf1369-1627-49bb-b4a8-14388eb3441e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1dcf028-0a0b-4b9d-b654-40f7627ebd36", "tag": "4c0cf892-f8a1-4d12-b359-b2673ecfd984"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:28:10 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-cc2cfff3-c19d-424b-a0e9-423f0981c76f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/ips" status: 200 len: 109 microversion: 2.1 time: 0.042708 Apr 13 15:28:10 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 281/835] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 15:28:10 2023] GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/ips => generated 109 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:28:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c633bce6-24e1-450d-bcfe-b396f2bfdff2 req-bdaf1369-1627-49bb-b4a8-14388eb3441e service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c633bce6-24e1-450d-bcfe-b396f2bfdff2 req-bdaf1369-1627-49bb-b4a8-14388eb3441e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c633bce6-24e1-450d-bcfe-b396f2bfdff2 req-bdaf1369-1627-49bb-b4a8-14388eb3441e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:10 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-c633bce6-24e1-450d-bcfe-b396f2bfdff2 req-bdaf1369-1627-49bb-b4a8-14388eb3441e service nova] Creating event network-changed:4c0cf892-f8a1-4d12-b359-b2673ecfd984 for instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 on user Apr 13 15:28:10 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-c633bce6-24e1-450d-bcfe-b396f2bfdff2 req-bdaf1369-1627-49bb-b4a8-14388eb3441e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129844 Apr 13 15:28:10 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 275/836] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:28:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:28:11 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-49a68334-c910-4c48-8aab-db7a0815cb28 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Action: 'create', calling method: .version_select at 0x7f3a8f887d00>, body: {"keypair": {"name": "tempest-keypair-1306550106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwAMm4sU/Gj3Vzrh3VZEg6lMGBJZ4u46yLNWpEl8KgjKMuyhNTe4lr+wZMx5cIPjHcyJlvVwL2g6JxTANaHJ7wVMvtjiUslCjAeTc41ba0ytt3OvquWPsvKDw4riIwsTg=="}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:28:11 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-49a68334-c910-4c48-8aab-db7a0815cb28 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Getting quotas for project 51df4613a6664a0fab857a9a83b6df62. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:28:11 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-49a68334-c910-4c48-8aab-db7a0815cb28 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Getting quotas for user a0bc1b61d8dc44aa8460fe2cd510c0a4 and project 51df4613a6664a0fab857a9a83b6df62. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:28:11 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-49a68334-c910-4c48-8aab-db7a0815cb28 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.098677 Apr 13 15:28:11 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 281/837] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 15:28:11 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 15:28:11 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92dff935-eedc-429a-8156-42f94b0a52eb"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:28:11 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:28:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:12 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316932 Apr 13 15:28:12 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 282/838] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:28:11 2023] POST /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:28:13 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-685773624", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a"}], "security_groups": [{"name": "tempest-securitygroup--1333195533"}], "key_name": "tempest-keypair-1306550106", "user_data": "}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:28:13 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] validate_networks() for [('1d3a06de-0d0e-4486-b2f4-a1de430fcd8a', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:28:13 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:28:13 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:28:13 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:28:13 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:28:13 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:28:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:13 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Getting quotas for project 51df4613a6664a0fab857a9a83b6df62. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:28:13 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Getting quotas for user a0bc1b61d8dc44aa8460fe2cd510c0a4 and project 51df4613a6664a0fab857a9a83b6df62. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:28:13 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:28:13 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:28:13 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.700193 Apr 13 15:28:13 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 276/839] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 15:28:13 2023] POST /compute/v2.1/servers => generated 400 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 15:28:13 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-61384e17-bf24-4211-a39a-488f55b65c03 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:28:13 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-61384e17-bf24-4211-a39a-488f55b65c03 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:28:13 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-61384e17-bf24-4211-a39a-488f55b65c03 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:28:13 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-61384e17-bf24-4211-a39a-488f55b65c03 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:28:13 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-61384e17-bf24-4211-a39a-488f55b65c03 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:28:13 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-61384e17-bf24-4211-a39a-488f55b65c03 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87" status: 200 len: 1275 microversion: 2.20 time: 0.066263 Apr 13 15:28:13 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 282/840] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:28:13 2023] GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87 => generated 1275 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:28:16 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-73279d8d-f633-4110-ad9b-054aa524071b req-1b579b30-fe37-4bc1-9a70-47a283d37b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9761101e-4bce-4e7b-8137-569bf8d27f87", "tag": "e2eabaa4-a35d-433f-850e-949af795e7ed"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:28:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-73279d8d-f633-4110-ad9b-054aa524071b req-1b579b30-fe37-4bc1-9a70-47a283d37b5b service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-73279d8d-f633-4110-ad9b-054aa524071b req-1b579b30-fe37-4bc1-9a70-47a283d37b5b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-73279d8d-f633-4110-ad9b-054aa524071b req-1b579b30-fe37-4bc1-9a70-47a283d37b5b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:16 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-73279d8d-f633-4110-ad9b-054aa524071b req-1b579b30-fe37-4bc1-9a70-47a283d37b5b service nova] Creating event network-changed:e2eabaa4-a35d-433f-850e-949af795e7ed for instance 9761101e-4bce-4e7b-8137-569bf8d27f87 on user Apr 13 15:28:16 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-73279d8d-f633-4110-ad9b-054aa524071b req-1b579b30-fe37-4bc1-9a70-47a283d37b5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031649 Apr 13 15:28:16 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 283/841] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:28:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:28:18 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-8eeeaf15-538a-43c6-ae8d-95acaf2edad0 req-7c7574b3-2c37-4217-b23d-8694c3495ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9761101e-4bce-4e7b-8137-569bf8d27f87", "name": "network-vif-plugged", "status": "completed", "tag": "e2eabaa4-a35d-433f-850e-949af795e7ed"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:28:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-8eeeaf15-538a-43c6-ae8d-95acaf2edad0 req-7c7574b3-2c37-4217-b23d-8694c3495ff6 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-8eeeaf15-538a-43c6-ae8d-95acaf2edad0 req-7c7574b3-2c37-4217-b23d-8694c3495ff6 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-8eeeaf15-538a-43c6-ae8d-95acaf2edad0 req-7c7574b3-2c37-4217-b23d-8694c3495ff6 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:18 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-8eeeaf15-538a-43c6-ae8d-95acaf2edad0 req-7c7574b3-2c37-4217-b23d-8694c3495ff6 service nova] Creating event network-vif-plugged:e2eabaa4-a35d-433f-850e-949af795e7ed for instance 9761101e-4bce-4e7b-8137-569bf8d27f87 on user Apr 13 15:28:18 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-8eeeaf15-538a-43c6-ae8d-95acaf2edad0 req-7c7574b3-2c37-4217-b23d-8694c3495ff6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030848 Apr 13 15:28:18 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 277/842] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:28:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:28:19 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:28:19 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:28:19 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:28:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:19 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:19 user devstack@n-api.service[61872]: DEBUG nova.objects.instance [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'services' on Instance uuid e1dcf028-0a0b-4b9d-b654-40f7627ebd36 {{(pid=61872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:28:20 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/os-volume_attachments/92dff935-eedc-429a-8156-42f94b0a52eb" status: 202 len: 0 microversion: 2.1 time: 0.272839 Apr 13 15:28:20 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 283/843] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:28:19 2023] DELETE /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/os-volume_attachments/92dff935-eedc-429a-8156-42f94b0a52eb => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 15:28:20 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-6723024f-e5b7-4376-9893-4d4b2252a1cb tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:28:20 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-6723024f-e5b7-4376-9893-4d4b2252a1cb tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:28:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-6723024f-e5b7-4376-9893-4d4b2252a1cb tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-6723024f-e5b7-4376-9893-4d4b2252a1cb tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-6723024f-e5b7-4376-9893-4d4b2252a1cb tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-6723024f-e5b7-4376-9893-4d4b2252a1cb tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-6723024f-e5b7-4376-9893-4d4b2252a1cb tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-6723024f-e5b7-4376-9893-4d4b2252a1cb tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:20 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-6723024f-e5b7-4376-9893-4d4b2252a1cb tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046717 Apr 13 15:28:20 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 284/844] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:28:20 2023] GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:28:20 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-50cdfd9d-72d2-434b-80cd-c4a84b831f75 req-5a982ede-2ad4-4deb-ac1d-e2fabc4fa9bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9761101e-4bce-4e7b-8137-569bf8d27f87", "name": "network-vif-plugged", "status": "completed", "tag": "e2eabaa4-a35d-433f-850e-949af795e7ed"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:28:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-50cdfd9d-72d2-434b-80cd-c4a84b831f75 req-5a982ede-2ad4-4deb-ac1d-e2fabc4fa9bf service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-50cdfd9d-72d2-434b-80cd-c4a84b831f75 req-5a982ede-2ad4-4deb-ac1d-e2fabc4fa9bf service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-50cdfd9d-72d2-434b-80cd-c4a84b831f75 req-5a982ede-2ad4-4deb-ac1d-e2fabc4fa9bf service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:20 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-50cdfd9d-72d2-434b-80cd-c4a84b831f75 req-5a982ede-2ad4-4deb-ac1d-e2fabc4fa9bf service nova] Creating event network-vif-plugged:e2eabaa4-a35d-433f-850e-949af795e7ed for instance 9761101e-4bce-4e7b-8137-569bf8d27f87 on user Apr 13 15:28:20 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-50cdfd9d-72d2-434b-80cd-c4a84b831f75 req-5a982ede-2ad4-4deb-ac1d-e2fabc4fa9bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044196 Apr 13 15:28:20 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 278/845] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:28:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:28:45 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:28:45 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:28:45 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:28:45 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:28:45 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:28:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:45 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:45 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Going to try to terminate instance {{(pid=61872) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:28:45 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1" status: 204 len: 0 microversion: 2.1 time: 0.151499 Apr 13 15:28:45 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 284/846] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:28:45 2023] DELETE /compute/v2.1/servers/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:28:45 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-d07d3bd5-9ad1-475b-9133-1df3c6bed9c6 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:28:45 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-d07d3bd5-9ad1-475b-9133-1df3c6bed9c6 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:28:45 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:28:45 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:28:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d07d3bd5-9ad1-475b-9133-1df3c6bed9c6 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d07d3bd5-9ad1-475b-9133-1df3c6bed9c6 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d07d3bd5-9ad1-475b-9133-1df3c6bed9c6 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d07d3bd5-9ad1-475b-9133-1df3c6bed9c6 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d07d3bd5-9ad1-475b-9133-1df3c6bed9c6 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d07d3bd5-9ad1-475b-9133-1df3c6bed9c6 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:45 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-d07d3bd5-9ad1-475b-9133-1df3c6bed9c6 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd5e19b47fa493395ca0432e6d85251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21b26110ef24c259a7f45913f46d6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:28:45 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-d07d3bd5-9ad1-475b-9133-1df3c6bed9c6 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1" status: 200 len: 1492 microversion: 2.1 time: 0.259725 Apr 13 15:28:45 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 285/847] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:28:45 2023] GET /compute/v2.1/servers/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 => generated 1492 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:28:45 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:28:45 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:28:45 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:28:45 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=26 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:28:45 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-4d2b1e4f-f67b-46fb-a411-542a8819b615 req-e173e661-4955-4ba6-9de4-b09e1a81083c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1", "name": "network-vif-unplugged", "status": "completed", "tag": "be7faa0d-9682-48e3-9a50-db4d80d7a54a"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:28:45 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-4d2b1e4f-f67b-46fb-a411-542a8819b615 req-e173e661-4955-4ba6-9de4-b09e1a81083c service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:45 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-4d2b1e4f-f67b-46fb-a411-542a8819b615 req-e173e661-4955-4ba6-9de4-b09e1a81083c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:45 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-4d2b1e4f-f67b-46fb-a411-542a8819b615 req-e173e661-4955-4ba6-9de4-b09e1a81083c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:45 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-4d2b1e4f-f67b-46fb-a411-542a8819b615 req-e173e661-4955-4ba6-9de4-b09e1a81083c service nova] Creating event network-vif-unplugged:be7faa0d-9682-48e3-9a50-db4d80d7a54a for instance 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 on user Apr 13 15:28:45 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-4d2b1e4f-f67b-46fb-a411-542a8819b615 req-e173e661-4955-4ba6-9de4-b09e1a81083c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116693 Apr 13 15:28:45 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 279/848] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:28:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:28:46 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-3975edf5-40eb-4ecb-b231-fb2d5412a17d req-1382dd62-1c82-421c-8367-5b27fee5ba89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1", "name": "network-vif-deleted", "tag": "be7faa0d-9682-48e3-9a50-db4d80d7a54a"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:28:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3975edf5-40eb-4ecb-b231-fb2d5412a17d req-1382dd62-1c82-421c-8367-5b27fee5ba89 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3975edf5-40eb-4ecb-b231-fb2d5412a17d req-1382dd62-1c82-421c-8367-5b27fee5ba89 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3975edf5-40eb-4ecb-b231-fb2d5412a17d req-1382dd62-1c82-421c-8367-5b27fee5ba89 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:46 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-3975edf5-40eb-4ecb-b231-fb2d5412a17d req-1382dd62-1c82-421c-8367-5b27fee5ba89 service nova] Creating event network-vif-deleted:be7faa0d-9682-48e3-9a50-db4d80d7a54a for instance 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 on user Apr 13 15:28:46 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-3975edf5-40eb-4ecb-b231-fb2d5412a17d req-1382dd62-1c82-421c-8367-5b27fee5ba89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036142 Apr 13 15:28:46 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 285/849] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:28:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:28:48 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-61d6c4ff-6161-4913-b1cb-c43d35ae4ca4 req-f9ed2db5-1c3d-44e3-a5c5-aa61fbb4cf8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1", "name": "network-vif-plugged", "status": "completed", "tag": "be7faa0d-9682-48e3-9a50-db4d80d7a54a"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:28:48 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-61d6c4ff-6161-4913-b1cb-c43d35ae4ca4 req-f9ed2db5-1c3d-44e3-a5c5-aa61fbb4cf8f service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:48 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-61d6c4ff-6161-4913-b1cb-c43d35ae4ca4 req-f9ed2db5-1c3d-44e3-a5c5-aa61fbb4cf8f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:48 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-61d6c4ff-6161-4913-b1cb-c43d35ae4ca4 req-f9ed2db5-1c3d-44e3-a5c5-aa61fbb4cf8f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:48 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-61d6c4ff-6161-4913-b1cb-c43d35ae4ca4 req-f9ed2db5-1c3d-44e3-a5c5-aa61fbb4cf8f service nova] Creating event network-vif-plugged:be7faa0d-9682-48e3-9a50-db4d80d7a54a for instance 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 on user Apr 13 15:28:48 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-61d6c4ff-6161-4913-b1cb-c43d35ae4ca4 req-f9ed2db5-1c3d-44e3-a5c5-aa61fbb4cf8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031458 Apr 13 15:28:48 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 286/850] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:28:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:28:48 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-ddbbfbec-2f08-4713-be9e-828e6b73e8b2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:28:48 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-ddbbfbec-2f08-4713-be9e-828e6b73e8b2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:28:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ddbbfbec-2f08-4713-be9e-828e6b73e8b2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ddbbfbec-2f08-4713-be9e-828e6b73e8b2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ddbbfbec-2f08-4713-be9e-828e6b73e8b2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ddbbfbec-2f08-4713-be9e-828e6b73e8b2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ddbbfbec-2f08-4713-be9e-828e6b73e8b2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ddbbfbec-2f08-4713-be9e-828e6b73e8b2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:48 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-ddbbfbec-2f08-4713-be9e-828e6b73e8b2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:28:48 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-ddbbfbec-2f08-4713-be9e-828e6b73e8b2 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643" status: 200 len: 1426 microversion: 2.1 time: 0.150271 Apr 13 15:28:48 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 280/851] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:28:48 2023] GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643 => generated 1426 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:28:59 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-af113cc4-9055-4055-8892-95e48f0354ad tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:28:59 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-af113cc4-9055-4055-8892-95e48f0354ad tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:28:59 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:28:59 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:28:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-af113cc4-9055-4055-8892-95e48f0354ad tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-af113cc4-9055-4055-8892-95e48f0354ad tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-af113cc4-9055-4055-8892-95e48f0354ad tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-af113cc4-9055-4055-8892-95e48f0354ad tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-af113cc4-9055-4055-8892-95e48f0354ad tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-af113cc4-9055-4055-8892-95e48f0354ad tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:59 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-af113cc4-9055-4055-8892-95e48f0354ad tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046551 Apr 13 15:28:59 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 286/852] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:28:59 2023] GET /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:28:59 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:28:59 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=8 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:28:59 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-5d80e3a2-fa38-4fcd-b0f8-a7badcae0c69 req-f71d330f-1b83-417c-9741-48f0a6fc61f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed13cfeb-933e-4cff-804a-f7404df7f2b0", "tag": "f72dcc71-6349-4489-8605-18cb581b5750"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:28:59 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:28:59 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:28:59 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=4 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:28:59 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=8 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:28:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-5d80e3a2-fa38-4fcd-b0f8-a7badcae0c69 req-f71d330f-1b83-417c-9741-48f0a6fc61f6 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-5d80e3a2-fa38-4fcd-b0f8-a7badcae0c69 req-f71d330f-1b83-417c-9741-48f0a6fc61f6 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-5d80e3a2-fa38-4fcd-b0f8-a7badcae0c69 req-f71d330f-1b83-417c-9741-48f0a6fc61f6 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:59 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-5d80e3a2-fa38-4fcd-b0f8-a7badcae0c69 req-f71d330f-1b83-417c-9741-48f0a6fc61f6 service nova] Creating event network-changed:f72dcc71-6349-4489-8605-18cb581b5750 for instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 on user Apr 13 15:28:59 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-5d80e3a2-fa38-4fcd-b0f8-a7badcae0c69 req-f71d330f-1b83-417c-9741-48f0a6fc61f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034244 Apr 13 15:28:59 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 281/853] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:28:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:28:59 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Going to try to terminate instance {{(pid=61873) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:28:59 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0" status: 204 len: 0 microversion: 2.1 time: 0.125344 Apr 13 15:28:59 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 287/854] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:28:59 2023] DELETE /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:28:59 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-92986a9a-4543-47f8-acd5-1cf90d129bc1 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:28:59 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-92986a9a-4543-47f8-acd5-1cf90d129bc1 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:28:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-92986a9a-4543-47f8-acd5-1cf90d129bc1 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-92986a9a-4543-47f8-acd5-1cf90d129bc1 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-92986a9a-4543-47f8-acd5-1cf90d129bc1 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:28:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-92986a9a-4543-47f8-acd5-1cf90d129bc1 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:28:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-92986a9a-4543-47f8-acd5-1cf90d129bc1 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:28:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-92986a9a-4543-47f8-acd5-1cf90d129bc1 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:00 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-92986a9a-4543-47f8-acd5-1cf90d129bc1 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e289648c244c77ab9ca48154da3cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318b9e0eb6a745df811d1daa4d6195fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:29:00 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-92986a9a-4543-47f8-acd5-1cf90d129bc1 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0" status: 200 len: 1662 microversion: 2.1 time: 0.196477 Apr 13 15:29:00 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 287/855] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:28:59 2023] GET /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0 => generated 1662 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:29:01 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-e58943bb-441c-47de-ac32-8521e1297e8e req-ce465a2f-001e-4f2a-ac60-a738a46aa7de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed13cfeb-933e-4cff-804a-f7404df7f2b0", "name": "network-vif-deleted", "tag": "f72dcc71-6349-4489-8605-18cb581b5750"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:29:01 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-e58943bb-441c-47de-ac32-8521e1297e8e req-ce465a2f-001e-4f2a-ac60-a738a46aa7de service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:01 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-e58943bb-441c-47de-ac32-8521e1297e8e req-ce465a2f-001e-4f2a-ac60-a738a46aa7de service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:01 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-e58943bb-441c-47de-ac32-8521e1297e8e req-ce465a2f-001e-4f2a-ac60-a738a46aa7de service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:01 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-e58943bb-441c-47de-ac32-8521e1297e8e req-ce465a2f-001e-4f2a-ac60-a738a46aa7de service nova] Creating event network-vif-deleted:f72dcc71-6349-4489-8605-18cb581b5750 for instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 on user Apr 13 15:29:01 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-e58943bb-441c-47de-ac32-8521e1297e8e req-ce465a2f-001e-4f2a-ac60-a738a46aa7de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034545 Apr 13 15:29:01 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 282/856] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:29:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:29:01 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-d2d779e2-5e02-4307-a6cf-4f7440048bb7 req-db1a6972-cfe7-4f0a-b1d8-c72d3d96435a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed13cfeb-933e-4cff-804a-f7404df7f2b0", "name": "network-vif-unplugged", "status": "completed", "tag": "f72dcc71-6349-4489-8605-18cb581b5750"}, {"server_uuid": "ed13cfeb-933e-4cff-804a-f7404df7f2b0", "name": "network-vif-plugged", "status": "completed", "tag": "f72dcc71-6349-4489-8605-18cb581b5750"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:29:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d2d779e2-5e02-4307-a6cf-4f7440048bb7 req-db1a6972-cfe7-4f0a-b1d8-c72d3d96435a service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d2d779e2-5e02-4307-a6cf-4f7440048bb7 req-db1a6972-cfe7-4f0a-b1d8-c72d3d96435a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:01 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d2d779e2-5e02-4307-a6cf-4f7440048bb7 req-db1a6972-cfe7-4f0a-b1d8-c72d3d96435a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:01 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-d2d779e2-5e02-4307-a6cf-4f7440048bb7 req-db1a6972-cfe7-4f0a-b1d8-c72d3d96435a service nova] Creating event network-vif-unplugged:f72dcc71-6349-4489-8605-18cb581b5750 for instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 on user Apr 13 15:29:01 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-d2d779e2-5e02-4307-a6cf-4f7440048bb7 req-db1a6972-cfe7-4f0a-b1d8-c72d3d96435a service nova] Creating event network-vif-plugged:f72dcc71-6349-4489-8605-18cb581b5750 for instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 on user Apr 13 15:29:01 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-d2d779e2-5e02-4307-a6cf-4f7440048bb7 req-db1a6972-cfe7-4f0a-b1d8-c72d3d96435a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031619 Apr 13 15:29:01 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 288/857] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:29:01 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:29:03 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-05061ea5-9fcd-40f6-9411-0c53d953a1fe tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:29:03 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-05061ea5-9fcd-40f6-9411-0c53d953a1fe tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:29:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-05061ea5-9fcd-40f6-9411-0c53d953a1fe tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-05061ea5-9fcd-40f6-9411-0c53d953a1fe tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-05061ea5-9fcd-40f6-9411-0c53d953a1fe tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-05061ea5-9fcd-40f6-9411-0c53d953a1fe tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-05061ea5-9fcd-40f6-9411-0c53d953a1fe tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:03 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-05061ea5-9fcd-40f6-9411-0c53d953a1fe tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:04 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-05061ea5-9fcd-40f6-9411-0c53d953a1fe tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:29:04 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-05061ea5-9fcd-40f6-9411-0c53d953a1fe tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:29:04 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-05061ea5-9fcd-40f6-9411-0c53d953a1fe tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:29:04 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-05061ea5-9fcd-40f6-9411-0c53d953a1fe tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87" status: 200 len: 1587 microversion: 2.20 time: 0.158509 Apr 13 15:29:04 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 288/858] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:29:03 2023] GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87 => generated 1587 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:29:07 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:29:07 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:29:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:07 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Going to try to terminate instance {{(pid=61871) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:29:07 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b" status: 204 len: 0 microversion: 2.1 time: 0.112172 Apr 13 15:29:07 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 283/859] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:29:07 2023] DELETE /compute/v2.1/servers/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:29:07 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-2c8be608-bc0f-40dc-87f2-fcd187eea64e tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:29:07 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-2c8be608-bc0f-40dc-87f2-fcd187eea64e tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:29:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2c8be608-bc0f-40dc-87f2-fcd187eea64e tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2c8be608-bc0f-40dc-87f2-fcd187eea64e tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2c8be608-bc0f-40dc-87f2-fcd187eea64e tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2c8be608-bc0f-40dc-87f2-fcd187eea64e tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2c8be608-bc0f-40dc-87f2-fcd187eea64e tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2c8be608-bc0f-40dc-87f2-fcd187eea64e tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:07 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-2c8be608-bc0f-40dc-87f2-fcd187eea64e tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6955546e4f4292a25acad709d27953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac07b9454744832b26bf6bd126763ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:29:07 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-2c8be608-bc0f-40dc-87f2-fcd187eea64e tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b" status: 200 len: 1499 microversion: 2.1 time: 0.147030 Apr 13 15:29:07 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 289/860] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:29:07 2023] GET /compute/v2.1/servers/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b => generated 1499 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:29:07 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-f60e1da5-8fb9-4f21-9baa-560c29182c82 req-f2ce3940-d890-4a82-bec0-1d64350b14f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b", "name": "network-vif-unplugged", "status": "completed", "tag": "d8276bf9-698e-4940-bace-2aee0c73f7d8"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:29:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f60e1da5-8fb9-4f21-9baa-560c29182c82 req-f2ce3940-d890-4a82-bec0-1d64350b14f5 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f60e1da5-8fb9-4f21-9baa-560c29182c82 req-f2ce3940-d890-4a82-bec0-1d64350b14f5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-f60e1da5-8fb9-4f21-9baa-560c29182c82 req-f2ce3940-d890-4a82-bec0-1d64350b14f5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:07 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-f60e1da5-8fb9-4f21-9baa-560c29182c82 req-f2ce3940-d890-4a82-bec0-1d64350b14f5 service nova] Creating event network-vif-unplugged:d8276bf9-698e-4940-bace-2aee0c73f7d8 for instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b on user Apr 13 15:29:07 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-f60e1da5-8fb9-4f21-9baa-560c29182c82 req-f2ce3940-d890-4a82-bec0-1d64350b14f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043312 Apr 13 15:29:07 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 289/861] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:29:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:29:08 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-2aa0da47-32e2-4af3-a386-9e1f26171c43 req-97bf5814-e227-4fb6-bd9c-3bd44e8ba995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b", "name": "network-vif-deleted", "tag": "d8276bf9-698e-4940-bace-2aee0c73f7d8"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:29:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-2aa0da47-32e2-4af3-a386-9e1f26171c43 req-97bf5814-e227-4fb6-bd9c-3bd44e8ba995 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-2aa0da47-32e2-4af3-a386-9e1f26171c43 req-97bf5814-e227-4fb6-bd9c-3bd44e8ba995 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-2aa0da47-32e2-4af3-a386-9e1f26171c43 req-97bf5814-e227-4fb6-bd9c-3bd44e8ba995 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:08 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-2aa0da47-32e2-4af3-a386-9e1f26171c43 req-97bf5814-e227-4fb6-bd9c-3bd44e8ba995 service nova] Creating event network-vif-deleted:d8276bf9-698e-4940-bace-2aee0c73f7d8 for instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b on user Apr 13 15:29:08 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-2aa0da47-32e2-4af3-a386-9e1f26171c43 req-97bf5814-e227-4fb6-bd9c-3bd44e8ba995 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030766 Apr 13 15:29:08 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 284/862] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:29:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:29:09 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-ca4d2c0f-dc3b-458d-91a7-6a04d22a98aa req-71fd6829-bb72-4854-990b-5929201328bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b", "name": "network-vif-plugged", "status": "completed", "tag": "d8276bf9-698e-4940-bace-2aee0c73f7d8"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:29:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-ca4d2c0f-dc3b-458d-91a7-6a04d22a98aa req-71fd6829-bb72-4854-990b-5929201328bc service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-ca4d2c0f-dc3b-458d-91a7-6a04d22a98aa req-71fd6829-bb72-4854-990b-5929201328bc service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-ca4d2c0f-dc3b-458d-91a7-6a04d22a98aa req-71fd6829-bb72-4854-990b-5929201328bc service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:09 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-ca4d2c0f-dc3b-458d-91a7-6a04d22a98aa req-71fd6829-bb72-4854-990b-5929201328bc service nova] Creating event network-vif-plugged:d8276bf9-698e-4940-bace-2aee0c73f7d8 for instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b on user Apr 13 15:29:09 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-ca4d2c0f-dc3b-458d-91a7-6a04d22a98aa req-71fd6829-bb72-4854-990b-5929201328bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031410 Apr 13 15:29:09 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 290/863] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:29:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:29:10 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-f9455b86-0400-490e-8749-a9cdf31b0a82 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:29:10 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-f9455b86-0400-490e-8749-a9cdf31b0a82 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:29:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f9455b86-0400-490e-8749-a9cdf31b0a82 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f9455b86-0400-490e-8749-a9cdf31b0a82 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f9455b86-0400-490e-8749-a9cdf31b0a82 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f9455b86-0400-490e-8749-a9cdf31b0a82 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f9455b86-0400-490e-8749-a9cdf31b0a82 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:10 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f9455b86-0400-490e-8749-a9cdf31b0a82 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:10 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-f9455b86-0400-490e-8749-a9cdf31b0a82 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048544 Apr 13 15:29:10 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 290/864] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:29:10 2023] GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:29:10 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:29:10 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:29:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:10 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:10 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Going to try to terminate instance {{(pid=61871) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:29:10 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36" status: 204 len: 0 microversion: 2.1 time: 0.113282 Apr 13 15:29:10 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 285/865] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:29:10 2023] DELETE /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:29:10 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7b640de2-a835-4796-b291-292464279481 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:29:10 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-7b640de2-a835-4796-b291-292464279481 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:29:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7b640de2-a835-4796-b291-292464279481 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7b640de2-a835-4796-b291-292464279481 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7b640de2-a835-4796-b291-292464279481 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7b640de2-a835-4796-b291-292464279481 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7b640de2-a835-4796-b291-292464279481 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:10 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7b640de2-a835-4796-b291-292464279481 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:10 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-7b640de2-a835-4796-b291-292464279481 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedd34ccc15c47f9a4fc96b080730acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3ba2d132c445039d0ae30ffd2bc64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:29:10 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7b640de2-a835-4796-b291-292464279481 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36" status: 200 len: 1668 microversion: 2.1 time: 0.168819 Apr 13 15:29:10 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 291/866] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:29:10 2023] GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36 => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:29:11 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-274a582c-5571-4a9f-b8e9-520f8f8bdc4c req-8df82aa8-2a34-4670-844b-a390b948e899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1dcf028-0a0b-4b9d-b654-40f7627ebd36", "name": "network-vif-unplugged", "status": "completed", "tag": "4c0cf892-f8a1-4d12-b359-b2673ecfd984"}, {"server_uuid": "e1dcf028-0a0b-4b9d-b654-40f7627ebd36", "name": "network-vif-plugged", "status": "completed", "tag": "4c0cf892-f8a1-4d12-b359-b2673ecfd984"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:29:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-274a582c-5571-4a9f-b8e9-520f8f8bdc4c req-8df82aa8-2a34-4670-844b-a390b948e899 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-274a582c-5571-4a9f-b8e9-520f8f8bdc4c req-8df82aa8-2a34-4670-844b-a390b948e899 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-274a582c-5571-4a9f-b8e9-520f8f8bdc4c req-8df82aa8-2a34-4670-844b-a390b948e899 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:11 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-274a582c-5571-4a9f-b8e9-520f8f8bdc4c req-8df82aa8-2a34-4670-844b-a390b948e899 service nova] Creating event network-vif-unplugged:4c0cf892-f8a1-4d12-b359-b2673ecfd984 for instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 on user Apr 13 15:29:11 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-274a582c-5571-4a9f-b8e9-520f8f8bdc4c req-8df82aa8-2a34-4670-844b-a390b948e899 service nova] Creating event network-vif-plugged:4c0cf892-f8a1-4d12-b359-b2673ecfd984 for instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 on user Apr 13 15:29:11 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-274a582c-5571-4a9f-b8e9-520f8f8bdc4c req-8df82aa8-2a34-4670-844b-a390b948e899 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031988 Apr 13 15:29:11 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 291/867] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:29:11 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:29:12 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-17fa331e-90f8-4879-a737-87f480b3f674 req-c4d08bf4-1352-4fd0-8200-b11567c034af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1dcf028-0a0b-4b9d-b654-40f7627ebd36", "name": "network-vif-deleted", "tag": "4c0cf892-f8a1-4d12-b359-b2673ecfd984"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:29:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-17fa331e-90f8-4879-a737-87f480b3f674 req-c4d08bf4-1352-4fd0-8200-b11567c034af service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-17fa331e-90f8-4879-a737-87f480b3f674 req-c4d08bf4-1352-4fd0-8200-b11567c034af service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-17fa331e-90f8-4879-a737-87f480b3f674 req-c4d08bf4-1352-4fd0-8200-b11567c034af service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:12 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-17fa331e-90f8-4879-a737-87f480b3f674 req-c4d08bf4-1352-4fd0-8200-b11567c034af service nova] Creating event network-vif-deleted:4c0cf892-f8a1-4d12-b359-b2673ecfd984 for instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 on user Apr 13 15:29:12 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-17fa331e-90f8-4879-a737-87f480b3f674 req-c4d08bf4-1352-4fd0-8200-b11567c034af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278718 Apr 13 15:29:12 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 286/868] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:29:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:29:35 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-71217f0c-8d5f-4793-a2dd-562950ca68c5 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:29:35 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-71217f0c-8d5f-4793-a2dd-562950ca68c5 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:29:35 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:29:35 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:29:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-71217f0c-8d5f-4793-a2dd-562950ca68c5 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-71217f0c-8d5f-4793-a2dd-562950ca68c5 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-71217f0c-8d5f-4793-a2dd-562950ca68c5 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-71217f0c-8d5f-4793-a2dd-562950ca68c5 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-71217f0c-8d5f-4793-a2dd-562950ca68c5 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-71217f0c-8d5f-4793-a2dd-562950ca68c5 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:35 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-71217f0c-8d5f-4793-a2dd-562950ca68c5 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] HTTP exception thrown: Instance 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 could not be found. Apr 13 15:29:35 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-71217f0c-8d5f-4793-a2dd-562950ca68c5 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Request method failure captured: Apr 13 15:29:35 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 HTTP/1.1 Apr 13 15:29:35 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:29:35 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:29:35 user devstack@n-api.service[61873]: Connection: close Apr 13 15:29:35 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:29:35 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:29:35 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:29:35 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:29:35 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:29:35 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOB829-xuj2CwHJeDI7X6axu-w1tn3_EXtyp0EqbF-g_dW_Y62580saeyXm15bDkYXXjzBKkhaMj4srruPOXNARkdKa3ObFZebhBI3qfuerLqToJCbz9LXCNFL9YgeFuVE7ZAwmSaGzuLcmlxk081owpwe7dh76jWZWkRWYje5_KTAvk Apr 13 15:29:35 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:29:35 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:29:35 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:29:35 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:29:35 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:29:35 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:29:35 user devstack@n-api.service[61873]: X-Project-Id: c21b26110ef24c259a7f45913f46d6af Apr 13 15:29:35 user devstack@n-api.service[61873]: X-Project-Name: tempest-VolumesActionsTest-1866117776 Apr 13 15:29:35 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:29:35 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:29:35 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c21b26110ef24c259a7f45913f46d6af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c21b26110ef24c259a7f45913f46d6af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c21b26110ef24c259a7f45913f46d6af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:29:35 user devstack@n-api.service[61873]: X-Tenant: tempest-VolumesActionsTest-1866117776 Apr 13 15:29:35 user devstack@n-api.service[61873]: X-Tenant-Id: c21b26110ef24c259a7f45913f46d6af Apr 13 15:29:35 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-VolumesActionsTest-1866117776 Apr 13 15:29:35 user devstack@n-api.service[61873]: X-User: tempest-VolumesActionsTest-1866117776-project-member Apr 13 15:29:35 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:29:35 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:29:35 user devstack@n-api.service[61873]: X-User-Id: 6fd5e19b47fa493395ca0432e6d85251 Apr 13 15:29:35 user devstack@n-api.service[61873]: X-User-Name: tempest-VolumesActionsTest-1866117776-project-member Apr 13 15:29:35 user devstack@n-api.service[61873]: method: > Apr 13 15:29:35 user devstack@n-api.service[61873]: exception: Instance 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 could not be found. Apr 13 15:29:35 user devstack@n-api.service[61873]: action_args: {'id': '2dba94be-8cb8-477e-aa7f-0239b9cdc4a1'} Apr 13 15:29:35 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 could not be found. Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 could not be found. Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 could not be found. Apr 13 15:29:35 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:29:35 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-71217f0c-8d5f-4793-a2dd-562950ca68c5 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Returning 404 to user: Instance 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:29:35 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-71217f0c-8d5f-4793-a2dd-562950ca68c5 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1" status: 404 len: 111 microversion: 2.1 time: 0.055947 Apr 13 15:29:35 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 292/869] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:29:35 2023] GET /compute/v2.1/servers/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:29:48 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-12073159-6a6c-48f9-90c5-ea6b9ca3a4e8 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:29:48 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-12073159-6a6c-48f9-90c5-ea6b9ca3a4e8 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:29:48 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=12 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:29:48 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=28 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:29:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-12073159-6a6c-48f9-90c5-ea6b9ca3a4e8 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-12073159-6a6c-48f9-90c5-ea6b9ca3a4e8 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-12073159-6a6c-48f9-90c5-ea6b9ca3a4e8 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-12073159-6a6c-48f9-90c5-ea6b9ca3a4e8 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-12073159-6a6c-48f9-90c5-ea6b9ca3a4e8 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-12073159-6a6c-48f9-90c5-ea6b9ca3a4e8 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:48 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-12073159-6a6c-48f9-90c5-ea6b9ca3a4e8 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.104506 Apr 13 15:29:48 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 292/870] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 15:29:48 2023] GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643/os-interface => generated 282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:29:49 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:29:49 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:29:49 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-06b14eee-c068-4f81-820a-4ff0851c6c0e req-23f05be0-dca1-4575-8aa4-ec08d98bea42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e8e652-d56c-45b6-92ff-a50406ea48e9", "tag": "018bebd6-4323-4f9d-8c6d-6da9a7934a97"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:29:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-06b14eee-c068-4f81-820a-4ff0851c6c0e req-23f05be0-dca1-4575-8aa4-ec08d98bea42 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-06b14eee-c068-4f81-820a-4ff0851c6c0e req-23f05be0-dca1-4575-8aa4-ec08d98bea42 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-06b14eee-c068-4f81-820a-4ff0851c6c0e req-23f05be0-dca1-4575-8aa4-ec08d98bea42 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:49 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-06b14eee-c068-4f81-820a-4ff0851c6c0e req-23f05be0-dca1-4575-8aa4-ec08d98bea42 service nova] Creating event network-changed:018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 on user Apr 13 15:29:49 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-06b14eee-c068-4f81-820a-4ff0851c6c0e req-23f05be0-dca1-4575-8aa4-ec08d98bea42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033959 Apr 13 15:29:49 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 287/871] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:29:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:29:49 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-10d11ff2-db01-4bfd-a567-141a6d397e7f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:29:49 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-10d11ff2-db01-4bfd-a567-141a6d397e7f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:29:49 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:29:49 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:29:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-10d11ff2-db01-4bfd-a567-141a6d397e7f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-10d11ff2-db01-4bfd-a567-141a6d397e7f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-10d11ff2-db01-4bfd-a567-141a6d397e7f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-10d11ff2-db01-4bfd-a567-141a6d397e7f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-10d11ff2-db01-4bfd-a567-141a6d397e7f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-10d11ff2-db01-4bfd-a567-141a6d397e7f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:49 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-10d11ff2-db01-4bfd-a567-141a6d397e7f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:29:49 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-10d11ff2-db01-4bfd-a567-141a6d397e7f tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643" status: 200 len: 1426 microversion: 2.1 time: 0.167310 Apr 13 15:29:49 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 293/872] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:29:49 2023] GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643 => generated 1426 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Old instance type m1.nano, new instance type m1.micro {{(pid=61872) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting quotas for project 9154e4239a1a42a3820c27563ba0513f. Resources: {'cores', 'ram'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting quotas for user 3c12c62d4137473596571e523163e718 and project 9154e4239a1a42a3820c27563ba0513f. Resources: {'cores', 'ram'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor limits 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image limits 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor pref 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image pref 0:0:0 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:29:49 user devstack@n-api.service[61872]: DEBUG nova.virt.hardware [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:29:49 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643/action" status: 202 len: 0 microversion: 2.1 time: 0.417698 Apr 13 15:29:49 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 293/873] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:29:49 2023] POST /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 15:29:49 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-918ce31d-a775-40b5-9f8f-7b691c87e558 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:29:49 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-918ce31d-a775-40b5-9f8f-7b691c87e558 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:29:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-918ce31d-a775-40b5-9f8f-7b691c87e558 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-918ce31d-a775-40b5-9f8f-7b691c87e558 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-918ce31d-a775-40b5-9f8f-7b691c87e558 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-918ce31d-a775-40b5-9f8f-7b691c87e558 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-918ce31d-a775-40b5-9f8f-7b691c87e558 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-918ce31d-a775-40b5-9f8f-7b691c87e558 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:50 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-918ce31d-a775-40b5-9f8f-7b691c87e558 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:29:50 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-918ce31d-a775-40b5-9f8f-7b691c87e558 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643" status: 200 len: 1435 microversion: 2.1 time: 0.146853 Apr 13 15:29:50 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 288/874] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:29:49 2023] GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643 => generated 1435 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:29:50 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-58637367-d2e8-4836-9d08-929e8b3c9a10 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:29:50 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-58637367-d2e8-4836-9d08-929e8b3c9a10 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:29:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-58637367-d2e8-4836-9d08-929e8b3c9a10 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-58637367-d2e8-4836-9d08-929e8b3c9a10 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-58637367-d2e8-4836-9d08-929e8b3c9a10 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-58637367-d2e8-4836-9d08-929e8b3c9a10 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-58637367-d2e8-4836-9d08-929e8b3c9a10 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-58637367-d2e8-4836-9d08-929e8b3c9a10 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:50 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-58637367-d2e8-4836-9d08-929e8b3c9a10 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] HTTP exception thrown: Instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 could not be found. Apr 13 15:29:50 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-58637367-d2e8-4836-9d08-929e8b3c9a10 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Request method failure captured: Apr 13 15:29:50 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0 HTTP/1.1 Apr 13 15:29:50 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:29:50 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:29:50 user devstack@n-api.service[61873]: Connection: close Apr 13 15:29:50 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:29:50 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:29:50 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:29:50 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:29:50 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:29:50 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOB5OYmV_Z7cVduDWwcEQSUOMRC6fZpwzm9bPif3HSL9IVY4_EjdZIcicpg0m6gcsnicTqRoct8b5KUmxHGHwiiCI36SOarDBJPsO8WZ2gL0x-PlYfI5IHad6ioIceXEnljoLM3heCTWMqsoEHoIwNVrOTP-oyVu-mulzBjEyx-WwxNE Apr 13 15:29:50 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:29:50 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:29:50 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:29:50 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:29:50 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:29:50 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:29:50 user devstack@n-api.service[61873]: X-Project-Id: 318b9e0eb6a745df811d1daa4d6195fc Apr 13 15:29:50 user devstack@n-api.service[61873]: X-Project-Name: tempest-TestStampPattern-1572934421 Apr 13 15:29:50 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:29:50 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:29:50 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/318b9e0eb6a745df811d1daa4d6195fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/318b9e0eb6a745df811d1daa4d6195fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/318b9e0eb6a745df811d1daa4d6195fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:29:50 user devstack@n-api.service[61873]: X-Tenant: tempest-TestStampPattern-1572934421 Apr 13 15:29:50 user devstack@n-api.service[61873]: X-Tenant-Id: 318b9e0eb6a745df811d1daa4d6195fc Apr 13 15:29:50 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-TestStampPattern-1572934421 Apr 13 15:29:50 user devstack@n-api.service[61873]: X-User: tempest-TestStampPattern-1572934421-project-member Apr 13 15:29:50 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:29:50 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:29:50 user devstack@n-api.service[61873]: X-User-Id: 78e289648c244c77ab9ca48154da3cde Apr 13 15:29:50 user devstack@n-api.service[61873]: X-User-Name: tempest-TestStampPattern-1572934421-project-member Apr 13 15:29:50 user devstack@n-api.service[61873]: method: > Apr 13 15:29:50 user devstack@n-api.service[61873]: exception: Instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 could not be found. Apr 13 15:29:50 user devstack@n-api.service[61873]: action_args: {'id': 'ed13cfeb-933e-4cff-804a-f7404df7f2b0'} Apr 13 15:29:50 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 could not be found. Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 could not be found. Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 could not be found. Apr 13 15:29:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:29:50 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-58637367-d2e8-4836-9d08-929e8b3c9a10 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Returning 404 to user: Instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:29:50 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-58637367-d2e8-4836-9d08-929e8b3c9a10 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0" status: 404 len: 111 microversion: 2.1 time: 0.031082 Apr 13 15:29:50 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 294/875] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:29:50 2023] GET /compute/v2.1/servers/ed13cfeb-933e-4cff-804a-f7404df7f2b0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:29:51 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-a3708ac2-a359-49e0-8da6-23ed78f7cb05 req-5d181cab-6025-413f-a2fd-de60259904bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4211d816-b8aa-452e-9587-bf131e42d643", "tag": "e42a12d0-d042-4277-83a6-7141c1df1ea2"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:29:51 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a3708ac2-a359-49e0-8da6-23ed78f7cb05 req-5d181cab-6025-413f-a2fd-de60259904bd service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:51 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a3708ac2-a359-49e0-8da6-23ed78f7cb05 req-5d181cab-6025-413f-a2fd-de60259904bd service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:51 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a3708ac2-a359-49e0-8da6-23ed78f7cb05 req-5d181cab-6025-413f-a2fd-de60259904bd service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:51 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-a3708ac2-a359-49e0-8da6-23ed78f7cb05 req-5d181cab-6025-413f-a2fd-de60259904bd service nova] Creating event network-changed:e42a12d0-d042-4277-83a6-7141c1df1ea2 for instance 4211d816-b8aa-452e-9587-bf131e42d643 on user Apr 13 15:29:51 user devstack@n-api.service[61872]: DEBUG nova.compute.api [req-a3708ac2-a359-49e0-8da6-23ed78f7cb05 req-5d181cab-6025-413f-a2fd-de60259904bd service nova] Instance 4211d816-b8aa-452e-9587-bf131e42d643 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 15:29:51 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-a3708ac2-a359-49e0-8da6-23ed78f7cb05 req-5d181cab-6025-413f-a2fd-de60259904bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049706 Apr 13 15:29:51 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 294/876] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:29:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:29:52 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-f18aff3b-5f65-40a2-bc10-4061d554e020 req-1572734e-d0b8-4e29-b94b-b53815b15eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4211d816-b8aa-452e-9587-bf131e42d643", "name": "network-vif-unplugged", "status": "completed", "tag": "e42a12d0-d042-4277-83a6-7141c1df1ea2"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:29:52 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-f18aff3b-5f65-40a2-bc10-4061d554e020 req-1572734e-d0b8-4e29-b94b-b53815b15eeb service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:52 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-f18aff3b-5f65-40a2-bc10-4061d554e020 req-1572734e-d0b8-4e29-b94b-b53815b15eeb service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:52 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-f18aff3b-5f65-40a2-bc10-4061d554e020 req-1572734e-d0b8-4e29-b94b-b53815b15eeb service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:52 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-f18aff3b-5f65-40a2-bc10-4061d554e020 req-1572734e-d0b8-4e29-b94b-b53815b15eeb service nova] Creating event network-vif-unplugged:e42a12d0-d042-4277-83a6-7141c1df1ea2 for instance 4211d816-b8aa-452e-9587-bf131e42d643 on user Apr 13 15:29:52 user devstack@n-api.service[61871]: DEBUG nova.compute.api [req-f18aff3b-5f65-40a2-bc10-4061d554e020 req-1572734e-d0b8-4e29-b94b-b53815b15eeb service nova] Instance 4211d816-b8aa-452e-9587-bf131e42d643 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 15:29:52 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-f18aff3b-5f65-40a2-bc10-4061d554e020 req-1572734e-d0b8-4e29-b94b-b53815b15eeb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039686 Apr 13 15:29:52 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 289/877] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:29:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:29:54 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-3e6e911a-6b29-492a-bdf6-03a4887c55eb req-f2787528-3ccb-49ed-a0f1-ced1367f2de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4211d816-b8aa-452e-9587-bf131e42d643", "name": "network-vif-plugged", "status": "completed", "tag": "e42a12d0-d042-4277-83a6-7141c1df1ea2"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:29:54 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3e6e911a-6b29-492a-bdf6-03a4887c55eb req-f2787528-3ccb-49ed-a0f1-ced1367f2de7 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:54 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3e6e911a-6b29-492a-bdf6-03a4887c55eb req-f2787528-3ccb-49ed-a0f1-ced1367f2de7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:54 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-3e6e911a-6b29-492a-bdf6-03a4887c55eb req-f2787528-3ccb-49ed-a0f1-ced1367f2de7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:54 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-3e6e911a-6b29-492a-bdf6-03a4887c55eb req-f2787528-3ccb-49ed-a0f1-ced1367f2de7 service nova] Creating event network-vif-plugged:e42a12d0-d042-4277-83a6-7141c1df1ea2 for instance 4211d816-b8aa-452e-9587-bf131e42d643 on user Apr 13 15:29:54 user devstack@n-api.service[61873]: DEBUG nova.compute.api [req-3e6e911a-6b29-492a-bdf6-03a4887c55eb req-f2787528-3ccb-49ed-a0f1-ced1367f2de7 service nova] Instance 4211d816-b8aa-452e-9587-bf131e42d643 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61873) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 15:29:54 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-3e6e911a-6b29-492a-bdf6-03a4887c55eb req-f2787528-3ccb-49ed-a0f1-ced1367f2de7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038706 Apr 13 15:29:54 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 295/878] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:29:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:29:54 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e78d79a2-a1dc-430e-89dd-8a003e323ccd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:29:54 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-e78d79a2-a1dc-430e-89dd-8a003e323ccd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:29:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e78d79a2-a1dc-430e-89dd-8a003e323ccd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e78d79a2-a1dc-430e-89dd-8a003e323ccd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e78d79a2-a1dc-430e-89dd-8a003e323ccd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e78d79a2-a1dc-430e-89dd-8a003e323ccd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e78d79a2-a1dc-430e-89dd-8a003e323ccd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e78d79a2-a1dc-430e-89dd-8a003e323ccd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:55 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-e78d79a2-a1dc-430e-89dd-8a003e323ccd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] HTTP exception thrown: Instance 42464137-e247-4191-8ed4-4bbdbe392f95 is not attached to volume 8ab95335-13ea-472f-8b96-919fb6f2cc1e Apr 13 15:29:55 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e78d79a2-a1dc-430e-89dd-8a003e323ccd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Request method failure captured: Apr 13 15:29:55 user devstack@n-api.service[61872]: request: DELETE /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95/os-volume_attachments/8ab95335-13ea-472f-8b96-919fb6f2cc1e HTTP/1.1 Apr 13 15:29:55 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:29:55 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:29:55 user devstack@n-api.service[61872]: Connection: close Apr 13 15:29:55 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:29:55 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:29:55 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:29:55 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:29:55 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:29:55 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOB5OYmV_Z7cVduDWwcEQSUOMRC6fZpwzm9bPif3HSL9IVY4_EjdZIcicpg0m6gcsnicTqRoct8b5KUmxHGHwiiCI36SOarDBJPsO8WZ2gL0x-PlYfI5IHad6ioIceXEnljoLM3heCTWMqsoEHoIwNVrOTP-oyVu-mulzBjEyx-WwxNE Apr 13 15:29:55 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:29:55 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:29:55 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:29:55 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:29:55 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:29:55 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:29:55 user devstack@n-api.service[61872]: X-Project-Id: 318b9e0eb6a745df811d1daa4d6195fc Apr 13 15:29:55 user devstack@n-api.service[61872]: X-Project-Name: tempest-TestStampPattern-1572934421 Apr 13 15:29:55 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:29:55 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:29:55 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/318b9e0eb6a745df811d1daa4d6195fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/318b9e0eb6a745df811d1daa4d6195fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/318b9e0eb6a745df811d1daa4d6195fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:29:55 user devstack@n-api.service[61872]: X-Tenant: tempest-TestStampPattern-1572934421 Apr 13 15:29:55 user devstack@n-api.service[61872]: X-Tenant-Id: 318b9e0eb6a745df811d1daa4d6195fc Apr 13 15:29:55 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-TestStampPattern-1572934421 Apr 13 15:29:55 user devstack@n-api.service[61872]: X-User: tempest-TestStampPattern-1572934421-project-member Apr 13 15:29:55 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:29:55 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:29:55 user devstack@n-api.service[61872]: X-User-Id: 78e289648c244c77ab9ca48154da3cde Apr 13 15:29:55 user devstack@n-api.service[61872]: X-User-Name: tempest-TestStampPattern-1572934421-project-member Apr 13 15:29:55 user devstack@n-api.service[61872]: method: > Apr 13 15:29:55 user devstack@n-api.service[61872]: exception: Instance 42464137-e247-4191-8ed4-4bbdbe392f95 is not attached to volume 8ab95335-13ea-472f-8b96-919fb6f2cc1e Apr 13 15:29:55 user devstack@n-api.service[61872]: action_args: {'server_id': '42464137-e247-4191-8ed4-4bbdbe392f95', 'id': '8ab95335-13ea-472f-8b96-919fb6f2cc1e'} Apr 13 15:29:55 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8ab95335-13ea-472f-8b96-919fb6f2cc1e. Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42464137-e247-4191-8ed4-4bbdbe392f95 is not attached to volume 8ab95335-13ea-472f-8b96-919fb6f2cc1e Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42464137-e247-4191-8ed4-4bbdbe392f95 is not attached to volume 8ab95335-13ea-472f-8b96-919fb6f2cc1e Apr 13 15:29:55 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:29:55 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e78d79a2-a1dc-430e-89dd-8a003e323ccd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Returning 404 to user: Instance 42464137-e247-4191-8ed4-4bbdbe392f95 is not attached to volume 8ab95335-13ea-472f-8b96-919fb6f2cc1e {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:29:55 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-e78d79a2-a1dc-430e-89dd-8a003e323ccd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95/os-volume_attachments/8ab95335-13ea-472f-8b96-919fb6f2cc1e" status: 404 len: 154 microversion: 2.1 time: 0.143509 Apr 13 15:29:55 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 295/879] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:29:54 2023] DELETE /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95/os-volume_attachments/8ab95335-13ea-472f-8b96-919fb6f2cc1e => generated 154 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:29:55 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:29:55 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:29:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:55 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Going to try to terminate instance {{(pid=61871) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:29:55 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95" status: 204 len: 0 microversion: 2.1 time: 0.108927 Apr 13 15:29:55 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 290/880] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:29:55 2023] DELETE /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:29:55 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f33fa459-36b0-425d-b969-4738abeea797 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:29:55 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-f33fa459-36b0-425d-b969-4738abeea797 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:29:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f33fa459-36b0-425d-b969-4738abeea797 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f33fa459-36b0-425d-b969-4738abeea797 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f33fa459-36b0-425d-b969-4738abeea797 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f33fa459-36b0-425d-b969-4738abeea797 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f33fa459-36b0-425d-b969-4738abeea797 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:55 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f33fa459-36b0-425d-b969-4738abeea797 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:56 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-f33fa459-36b0-425d-b969-4738abeea797 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e289648c244c77ab9ca48154da3cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318b9e0eb6a745df811d1daa4d6195fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:29:56 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-f33fa459-36b0-425d-b969-4738abeea797 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95" status: 200 len: 1662 microversion: 2.1 time: 0.362121 Apr 13 15:29:56 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 296/881] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:29:55 2023] GET /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95 => generated 1662 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:29:56 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-091ec342-08cc-464c-b0c9-11c4f316544d req-ede0d910-78c3-4853-a9e5-249e986334e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42464137-e247-4191-8ed4-4bbdbe392f95", "name": "network-vif-unplugged", "status": "completed", "tag": "2fcc3406-d672-49a1-85b8-5f2ce187b541"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:29:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-091ec342-08cc-464c-b0c9-11c4f316544d req-ede0d910-78c3-4853-a9e5-249e986334e6 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-091ec342-08cc-464c-b0c9-11c4f316544d req-ede0d910-78c3-4853-a9e5-249e986334e6 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-091ec342-08cc-464c-b0c9-11c4f316544d req-ede0d910-78c3-4853-a9e5-249e986334e6 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:56 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-091ec342-08cc-464c-b0c9-11c4f316544d req-ede0d910-78c3-4853-a9e5-249e986334e6 service nova] Creating event network-vif-unplugged:2fcc3406-d672-49a1-85b8-5f2ce187b541 for instance 42464137-e247-4191-8ed4-4bbdbe392f95 on user Apr 13 15:29:56 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-091ec342-08cc-464c-b0c9-11c4f316544d req-ede0d910-78c3-4853-a9e5-249e986334e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042594 Apr 13 15:29:56 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 296/882] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:29:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:29:56 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-ccde476d-cd91-4ede-8f79-d452733c7cd2 req-e6ab7523-9baf-496f-ad6e-4563d5099f2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42464137-e247-4191-8ed4-4bbdbe392f95", "tag": "2fcc3406-d672-49a1-85b8-5f2ce187b541"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:29:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ccde476d-cd91-4ede-8f79-d452733c7cd2 req-e6ab7523-9baf-496f-ad6e-4563d5099f2e service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ccde476d-cd91-4ede-8f79-d452733c7cd2 req-e6ab7523-9baf-496f-ad6e-4563d5099f2e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ccde476d-cd91-4ede-8f79-d452733c7cd2 req-e6ab7523-9baf-496f-ad6e-4563d5099f2e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:56 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-ccde476d-cd91-4ede-8f79-d452733c7cd2 req-e6ab7523-9baf-496f-ad6e-4563d5099f2e service nova] Creating event network-changed:2fcc3406-d672-49a1-85b8-5f2ce187b541 for instance 42464137-e247-4191-8ed4-4bbdbe392f95 on user Apr 13 15:29:56 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-ccde476d-cd91-4ede-8f79-d452733c7cd2 req-e6ab7523-9baf-496f-ad6e-4563d5099f2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035196 Apr 13 15:29:56 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 291/883] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:29:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:29:57 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c09fd89d-d458-4565-8520-4f2975d4d05b tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:29:57 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-c09fd89d-d458-4565-8520-4f2975d4d05b tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:29:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c09fd89d-d458-4565-8520-4f2975d4d05b tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c09fd89d-d458-4565-8520-4f2975d4d05b tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c09fd89d-d458-4565-8520-4f2975d4d05b tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c09fd89d-d458-4565-8520-4f2975d4d05b tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c09fd89d-d458-4565-8520-4f2975d4d05b tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c09fd89d-d458-4565-8520-4f2975d4d05b tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:57 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-c09fd89d-d458-4565-8520-4f2975d4d05b tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] HTTP exception thrown: Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b could not be found. Apr 13 15:29:57 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c09fd89d-d458-4565-8520-4f2975d4d05b tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Request method failure captured: Apr 13 15:29:57 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b HTTP/1.1 Apr 13 15:29:57 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:29:57 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:29:57 user devstack@n-api.service[61873]: Connection: close Apr 13 15:29:57 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:29:57 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:29:57 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:29:57 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:29:57 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:29:57 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOB7kKQ44jHGyRwLCnKetXuptxn0znpv1SCvdmpcfSLebOWuTJbaDmT9s8_KTZV_Nzw6Nf9PmJBaiMYXvtuNBpo17X0Kcfru9DbFvcC33q8yjZQ1ouKJDxhQ0wQ0H-ndflDRipvny3s7y8abf-HRxzRrh7eJlHlgT1EnBB5Pboqyao0A Apr 13 15:29:57 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:29:57 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:29:57 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:29:57 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:29:57 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:29:57 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:29:57 user devstack@n-api.service[61873]: X-Project-Id: 1ac07b9454744832b26bf6bd126763ec Apr 13 15:29:57 user devstack@n-api.service[61873]: X-Project-Name: tempest-ServersNegativeTestJSON-187650290 Apr 13 15:29:57 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:29:57 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:29:57 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1ac07b9454744832b26bf6bd126763ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ac07b9454744832b26bf6bd126763ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ac07b9454744832b26bf6bd126763ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:29:57 user devstack@n-api.service[61873]: X-Tenant: tempest-ServersNegativeTestJSON-187650290 Apr 13 15:29:57 user devstack@n-api.service[61873]: X-Tenant-Id: 1ac07b9454744832b26bf6bd126763ec Apr 13 15:29:57 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187650290 Apr 13 15:29:57 user devstack@n-api.service[61873]: X-User: tempest-ServersNegativeTestJSON-187650290-project-member Apr 13 15:29:57 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:29:57 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:29:57 user devstack@n-api.service[61873]: X-User-Id: 3a6955546e4f4292a25acad709d27953 Apr 13 15:29:57 user devstack@n-api.service[61873]: X-User-Name: tempest-ServersNegativeTestJSON-187650290-project-member Apr 13 15:29:57 user devstack@n-api.service[61873]: method: > Apr 13 15:29:57 user devstack@n-api.service[61873]: exception: Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b could not be found. Apr 13 15:29:57 user devstack@n-api.service[61873]: action_args: {'id': '8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b'} Apr 13 15:29:57 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b could not be found. Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b could not be found. Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b could not be found. Apr 13 15:29:57 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:29:57 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c09fd89d-d458-4565-8520-4f2975d4d05b tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Returning 404 to user: Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:29:57 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-c09fd89d-d458-4565-8520-4f2975d4d05b tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b" status: 404 len: 111 microversion: 2.1 time: 0.028448 Apr 13 15:29:57 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 297/884] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:29:57 2023] GET /compute/v2.1/servers/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:29:57 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-b79c6549-587c-4915-809b-9cef89583b4f tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:29:57 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-b79c6549-587c-4915-809b-9cef89583b4f tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:29:57 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b79c6549-587c-4915-809b-9cef89583b4f tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:57 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b79c6549-587c-4915-809b-9cef89583b4f tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:57 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b79c6549-587c-4915-809b-9cef89583b4f tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:57 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b79c6549-587c-4915-809b-9cef89583b4f tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:57 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b79c6549-587c-4915-809b-9cef89583b4f tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:57 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b79c6549-587c-4915-809b-9cef89583b4f tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:57 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-b79c6549-587c-4915-809b-9cef89583b4f tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6955546e4f4292a25acad709d27953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac07b9454744832b26bf6bd126763ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:29:57 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-b79c6549-587c-4915-809b-9cef89583b4f tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22bb22bd-efa8-4679-979a-dd0ce28a79e3" status: 200 len: 1493 microversion: 2.1 time: 0.172688 Apr 13 15:29:57 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 297/885] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:29:57 2023] GET /compute/v2.1/servers/22bb22bd-efa8-4679-979a-dd0ce28a79e3 => generated 1493 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 15:29:58 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-a6f417da-c556-4896-967c-ef944d24bd6e req-12ef72d5-09e8-4c36-9049-426972414e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42464137-e247-4191-8ed4-4bbdbe392f95", "name": "network-vif-plugged", "status": "completed", "tag": "2fcc3406-d672-49a1-85b8-5f2ce187b541"}, {"server_uuid": "42464137-e247-4191-8ed4-4bbdbe392f95", "name": "network-vif-deleted", "tag": "2fcc3406-d672-49a1-85b8-5f2ce187b541"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:29:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a6f417da-c556-4896-967c-ef944d24bd6e req-12ef72d5-09e8-4c36-9049-426972414e5d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:29:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a6f417da-c556-4896-967c-ef944d24bd6e req-12ef72d5-09e8-4c36-9049-426972414e5d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:29:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-a6f417da-c556-4896-967c-ef944d24bd6e req-12ef72d5-09e8-4c36-9049-426972414e5d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:29:58 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-a6f417da-c556-4896-967c-ef944d24bd6e req-12ef72d5-09e8-4c36-9049-426972414e5d service nova] Creating event network-vif-plugged:2fcc3406-d672-49a1-85b8-5f2ce187b541 for instance 42464137-e247-4191-8ed4-4bbdbe392f95 on user Apr 13 15:29:58 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-a6f417da-c556-4896-967c-ef944d24bd6e req-12ef72d5-09e8-4c36-9049-426972414e5d service nova] Creating event network-vif-deleted:2fcc3406-d672-49a1-85b8-5f2ce187b541 for instance 42464137-e247-4191-8ed4-4bbdbe392f95 on user Apr 13 15:29:58 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-a6f417da-c556-4896-967c-ef944d24bd6e req-12ef72d5-09e8-4c36-9049-426972414e5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042493 Apr 13 15:29:58 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 292/886] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:29:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:30:00 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-b77c4be6-eaa4-40de-95c0-0ae461d04da3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:30:00 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-b77c4be6-eaa4-40de-95c0-0ae461d04da3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:30:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b77c4be6-eaa4-40de-95c0-0ae461d04da3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b77c4be6-eaa4-40de-95c0-0ae461d04da3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b77c4be6-eaa4-40de-95c0-0ae461d04da3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b77c4be6-eaa4-40de-95c0-0ae461d04da3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b77c4be6-eaa4-40de-95c0-0ae461d04da3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:00 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b77c4be6-eaa4-40de-95c0-0ae461d04da3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:00 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-b77c4be6-eaa4-40de-95c0-0ae461d04da3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] HTTP exception thrown: Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 could not be found. Apr 13 15:30:00 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-b77c4be6-eaa4-40de-95c0-0ae461d04da3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Request method failure captured: Apr 13 15:30:00 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36 HTTP/1.1 Apr 13 15:30:00 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:30:00 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:30:00 user devstack@n-api.service[61873]: Connection: close Apr 13 15:30:00 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:30:00 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:30:00 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:30:00 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:30:00 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:30:00 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBysJSC_pL1o3J9cVhCfPJH0RJxZJE2XjaF2Yq1nITqHQPAUJ-sY0C6ehk0hgyb5AGui4kwa-lWhEaqyW-11oCzt4s9SAjj7iiHUYBf3mDz8zQD6VpCcWxM23IvnmM9hydVYLDDtvrzvCJbTCSuVNPu3nJmaP7WJ6HL0s88zCkG70Us Apr 13 15:30:00 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:30:00 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:30:00 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:30:00 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:30:00 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:30:00 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:30:00 user devstack@n-api.service[61873]: X-Project-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:30:00 user devstack@n-api.service[61873]: X-Project-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:00 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:30:00 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:30:00 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:30:00 user devstack@n-api.service[61873]: X-Tenant: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:00 user devstack@n-api.service[61873]: X-Tenant-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:30:00 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:00 user devstack@n-api.service[61873]: X-User: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:30:00 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:30:00 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:30:00 user devstack@n-api.service[61873]: X-User-Id: fedd34ccc15c47f9a4fc96b080730acd Apr 13 15:30:00 user devstack@n-api.service[61873]: X-User-Name: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:30:00 user devstack@n-api.service[61873]: method: > Apr 13 15:30:00 user devstack@n-api.service[61873]: exception: Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 could not be found. Apr 13 15:30:00 user devstack@n-api.service[61873]: action_args: {'id': 'e1dcf028-0a0b-4b9d-b654-40f7627ebd36'} Apr 13 15:30:00 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 could not be found. Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 could not be found. Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 could not be found. Apr 13 15:30:00 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:00 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-b77c4be6-eaa4-40de-95c0-0ae461d04da3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Returning 404 to user: Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:30:00 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-b77c4be6-eaa4-40de-95c0-0ae461d04da3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36" status: 404 len: 111 microversion: 2.1 time: 0.032675 Apr 13 15:30:00 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 298/887] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:30:00 2023] GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:30:00 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-153346bf-abff-4f20-b62e-144f21a376fa tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '.version_select at 0x7f3a8f81feb0>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:30:00 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=3 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:30:00 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-153346bf-abff-4f20-b62e-144f21a376fa tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-99368010" status: 202 len: 0 microversion: 2.1 time: 0.027990 Apr 13 15:30:00 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 298/888] 10.0.0.210 () {62 vars in 1292 bytes} [Thu Apr 13 15:30:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-99368010 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:30:02 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-c7f16431-d5fb-43a7-8375-5110b7361f66 req-e6dae345-0f94-44b1-b88f-b9fca74bed14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4211d816-b8aa-452e-9587-bf131e42d643", "name": "network-vif-plugged", "status": "completed", "tag": "e42a12d0-d042-4277-83a6-7141c1df1ea2"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:30:02 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c7f16431-d5fb-43a7-8375-5110b7361f66 req-e6dae345-0f94-44b1-b88f-b9fca74bed14 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:02 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c7f16431-d5fb-43a7-8375-5110b7361f66 req-e6dae345-0f94-44b1-b88f-b9fca74bed14 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:02 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-c7f16431-d5fb-43a7-8375-5110b7361f66 req-e6dae345-0f94-44b1-b88f-b9fca74bed14 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:02 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-c7f16431-d5fb-43a7-8375-5110b7361f66 req-e6dae345-0f94-44b1-b88f-b9fca74bed14 service nova] Creating event network-vif-plugged:e42a12d0-d042-4277-83a6-7141c1df1ea2 for instance 4211d816-b8aa-452e-9587-bf131e42d643 on user Apr 13 15:30:02 user devstack@n-api.service[61871]: DEBUG nova.compute.api [req-c7f16431-d5fb-43a7-8375-5110b7361f66 req-e6dae345-0f94-44b1-b88f-b9fca74bed14 service nova] Instance 4211d816-b8aa-452e-9587-bf131e42d643 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 15:30:02 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-c7f16431-d5fb-43a7-8375-5110b7361f66 req-e6dae345-0f94-44b1-b88f-b9fca74bed14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049138 Apr 13 15:30:02 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 293/889] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:30:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:30:03 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-1fc86cac-c151-47a4-9af2-3946724ab9e3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:30:03 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-1fc86cac-c151-47a4-9af2-3946724ab9e3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:30:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1fc86cac-c151-47a4-9af2-3946724ab9e3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1fc86cac-c151-47a4-9af2-3946724ab9e3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1fc86cac-c151-47a4-9af2-3946724ab9e3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1fc86cac-c151-47a4-9af2-3946724ab9e3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1fc86cac-c151-47a4-9af2-3946724ab9e3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:03 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1fc86cac-c151-47a4-9af2-3946724ab9e3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:04 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-1fc86cac-c151-47a4-9af2-3946724ab9e3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] HTTP exception thrown: Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 could not be found. Apr 13 15:30:04 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-1fc86cac-c151-47a4-9af2-3946724ab9e3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Request method failure captured: Apr 13 15:30:04 user devstack@n-api.service[61873]: request: DELETE /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36 HTTP/1.1 Apr 13 15:30:04 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:30:04 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:30:04 user devstack@n-api.service[61873]: Connection: close Apr 13 15:30:04 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:30:04 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:30:04 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:30:04 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:30:04 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:30:04 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBysJSC_pL1o3J9cVhCfPJH0RJxZJE2XjaF2Yq1nITqHQPAUJ-sY0C6ehk0hgyb5AGui4kwa-lWhEaqyW-11oCzt4s9SAjj7iiHUYBf3mDz8zQD6VpCcWxM23IvnmM9hydVYLDDtvrzvCJbTCSuVNPu3nJmaP7WJ6HL0s88zCkG70Us Apr 13 15:30:04 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:30:04 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:30:04 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:30:04 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:30:04 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:30:04 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:30:04 user devstack@n-api.service[61873]: X-Project-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:30:04 user devstack@n-api.service[61873]: X-Project-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:04 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:30:04 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:30:04 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:30:04 user devstack@n-api.service[61873]: X-Tenant: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:04 user devstack@n-api.service[61873]: X-Tenant-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:30:04 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:04 user devstack@n-api.service[61873]: X-User: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:30:04 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:30:04 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:30:04 user devstack@n-api.service[61873]: X-User-Id: fedd34ccc15c47f9a4fc96b080730acd Apr 13 15:30:04 user devstack@n-api.service[61873]: X-User-Name: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:30:04 user devstack@n-api.service[61873]: method: > Apr 13 15:30:04 user devstack@n-api.service[61873]: exception: Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 could not be found. Apr 13 15:30:04 user devstack@n-api.service[61873]: action_args: {'id': 'e1dcf028-0a0b-4b9d-b654-40f7627ebd36'} Apr 13 15:30:04 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 could not be found. Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 could not be found. Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 could not be found. Apr 13 15:30:04 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:04 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-1fc86cac-c151-47a4-9af2-3946724ab9e3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Returning 404 to user: Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:30:04 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-1fc86cac-c151-47a4-9af2-3946724ab9e3 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36" status: 404 len: 111 microversion: 2.1 time: 0.042923 Apr 13 15:30:04 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 299/890] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:30:03 2023] DELETE /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:30:04 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d02446d4-1f21-4cb6-aa25-02c8ade1db9f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:30:04 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-d02446d4-1f21-4cb6-aa25-02c8ade1db9f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:30:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d02446d4-1f21-4cb6-aa25-02c8ade1db9f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d02446d4-1f21-4cb6-aa25-02c8ade1db9f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d02446d4-1f21-4cb6-aa25-02c8ade1db9f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d02446d4-1f21-4cb6-aa25-02c8ade1db9f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d02446d4-1f21-4cb6-aa25-02c8ade1db9f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:04 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d02446d4-1f21-4cb6-aa25-02c8ade1db9f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:04 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-d02446d4-1f21-4cb6-aa25-02c8ade1db9f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] HTTP exception thrown: Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 could not be found. Apr 13 15:30:04 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d02446d4-1f21-4cb6-aa25-02c8ade1db9f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Request method failure captured: Apr 13 15:30:04 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36 HTTP/1.1 Apr 13 15:30:04 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:30:04 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:30:04 user devstack@n-api.service[61872]: Connection: close Apr 13 15:30:04 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:30:04 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:30:04 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:30:04 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:30:04 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:30:04 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBysJSC_pL1o3J9cVhCfPJH0RJxZJE2XjaF2Yq1nITqHQPAUJ-sY0C6ehk0hgyb5AGui4kwa-lWhEaqyW-11oCzt4s9SAjj7iiHUYBf3mDz8zQD6VpCcWxM23IvnmM9hydVYLDDtvrzvCJbTCSuVNPu3nJmaP7WJ6HL0s88zCkG70Us Apr 13 15:30:04 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:30:04 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:30:04 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:30:04 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:30:04 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:30:04 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:30:04 user devstack@n-api.service[61872]: X-Project-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:30:04 user devstack@n-api.service[61872]: X-Project-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:04 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:30:04 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:30:04 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:30:04 user devstack@n-api.service[61872]: X-Tenant: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:04 user devstack@n-api.service[61872]: X-Tenant-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:30:04 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:04 user devstack@n-api.service[61872]: X-User: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:30:04 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:30:04 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:30:04 user devstack@n-api.service[61872]: X-User-Id: fedd34ccc15c47f9a4fc96b080730acd Apr 13 15:30:04 user devstack@n-api.service[61872]: X-User-Name: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:30:04 user devstack@n-api.service[61872]: method: > Apr 13 15:30:04 user devstack@n-api.service[61872]: exception: Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 could not be found. Apr 13 15:30:04 user devstack@n-api.service[61872]: action_args: {'id': 'e1dcf028-0a0b-4b9d-b654-40f7627ebd36'} Apr 13 15:30:04 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 could not be found. Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 could not be found. Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 could not be found. Apr 13 15:30:04 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:30:04 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d02446d4-1f21-4cb6-aa25-02c8ade1db9f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Returning 404 to user: Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:30:04 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-d02446d4-1f21-4cb6-aa25-02c8ade1db9f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36" status: 404 len: 111 microversion: 2.1 time: 0.033409 Apr 13 15:30:04 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 299/891] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:30:04 2023] GET /compute/v2.1/servers/e1dcf028-0a0b-4b9d-b654-40f7627ebd36 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:30:04 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-1841a214-73fa-4c1c-8aaf-0c4e82e5fb64 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:30:04 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-1841a214-73fa-4c1c-8aaf-0c4e82e5fb64 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:30:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1841a214-73fa-4c1c-8aaf-0c4e82e5fb64 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1841a214-73fa-4c1c-8aaf-0c4e82e5fb64 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1841a214-73fa-4c1c-8aaf-0c4e82e5fb64 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1841a214-73fa-4c1c-8aaf-0c4e82e5fb64 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1841a214-73fa-4c1c-8aaf-0c4e82e5fb64 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1841a214-73fa-4c1c-8aaf-0c4e82e5fb64 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:04 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-1841a214-73fa-4c1c-8aaf-0c4e82e5fb64 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.118903 Apr 13 15:30:04 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 294/892] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 15:30:04 2023] GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87/os-interface => generated 282 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:30:04 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-bda9a369-d24e-4278-8e55-1c60a5b7c61d req-064a9247-8f05-4e91-b07b-d44bb4318540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4211d816-b8aa-452e-9587-bf131e42d643", "name": "network-vif-plugged", "status": "completed", "tag": "e42a12d0-d042-4277-83a6-7141c1df1ea2"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:30:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-bda9a369-d24e-4278-8e55-1c60a5b7c61d req-064a9247-8f05-4e91-b07b-d44bb4318540 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-bda9a369-d24e-4278-8e55-1c60a5b7c61d req-064a9247-8f05-4e91-b07b-d44bb4318540 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-bda9a369-d24e-4278-8e55-1c60a5b7c61d req-064a9247-8f05-4e91-b07b-d44bb4318540 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:04 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-bda9a369-d24e-4278-8e55-1c60a5b7c61d req-064a9247-8f05-4e91-b07b-d44bb4318540 service nova] Creating event network-vif-plugged:e42a12d0-d042-4277-83a6-7141c1df1ea2 for instance 4211d816-b8aa-452e-9587-bf131e42d643 on user Apr 13 15:30:04 user devstack@n-api.service[61873]: DEBUG nova.compute.api [req-bda9a369-d24e-4278-8e55-1c60a5b7c61d req-064a9247-8f05-4e91-b07b-d44bb4318540 service nova] Instance 4211d816-b8aa-452e-9587-bf131e42d643 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61873) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 15:30:04 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-bda9a369-d24e-4278-8e55-1c60a5b7c61d req-064a9247-8f05-4e91-b07b-d44bb4318540 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042782 Apr 13 15:30:04 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 300/893] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:30:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:30:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-68f858b9-6e7d-4a02-a1af-3e0b34bd2a07 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:30:05 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-68f858b9-6e7d-4a02-a1af-3e0b34bd2a07 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:30:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-68f858b9-6e7d-4a02-a1af-3e0b34bd2a07 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-68f858b9-6e7d-4a02-a1af-3e0b34bd2a07 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-68f858b9-6e7d-4a02-a1af-3e0b34bd2a07 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-68f858b9-6e7d-4a02-a1af-3e0b34bd2a07 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-68f858b9-6e7d-4a02-a1af-3e0b34bd2a07 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-68f858b9-6e7d-4a02-a1af-3e0b34bd2a07 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:05 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-68f858b9-6e7d-4a02-a1af-3e0b34bd2a07 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87/ips" status: 200 len: 110 microversion: 2.20 time: 0.035548 Apr 13 15:30:05 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 300/894] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 13 15:30:05 2023] GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87/ips => generated 110 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-e36f22c1-0db9-407e-a034-62b6e9058505 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-e36f22c1-0db9-407e-a034-62b6e9058505 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e36f22c1-0db9-407e-a034-62b6e9058505 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e36f22c1-0db9-407e-a034-62b6e9058505 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e36f22c1-0db9-407e-a034-62b6e9058505 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e36f22c1-0db9-407e-a034-62b6e9058505 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e36f22c1-0db9-407e-a034-62b6e9058505 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e36f22c1-0db9-407e-a034-62b6e9058505 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:06 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-e36f22c1-0db9-407e-a034-62b6e9058505 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] HTTP exception thrown: Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e could not be found. Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-e36f22c1-0db9-407e-a034-62b6e9058505 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Request method failure captured: Apr 13 15:30:06 user devstack@n-api.service[61871]: request: DELETE /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e HTTP/1.1 Apr 13 15:30:06 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:30:06 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:30:06 user devstack@n-api.service[61871]: Connection: close Apr 13 15:30:06 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:30:06 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:30:06 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:30:06 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:30:06 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBysJSC_pL1o3J9cVhCfPJH0RJxZJE2XjaF2Yq1nITqHQPAUJ-sY0C6ehk0hgyb5AGui4kwa-lWhEaqyW-11oCzt4s9SAjj7iiHUYBf3mDz8zQD6VpCcWxM23IvnmM9hydVYLDDtvrzvCJbTCSuVNPu3nJmaP7WJ6HL0s88zCkG70Us Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Project-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Project-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Tenant: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Tenant-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:06 user devstack@n-api.service[61871]: X-User: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:30:06 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:30:06 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:30:06 user devstack@n-api.service[61871]: X-User-Id: fedd34ccc15c47f9a4fc96b080730acd Apr 13 15:30:06 user devstack@n-api.service[61871]: X-User-Name: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:30:06 user devstack@n-api.service[61871]: method: > Apr 13 15:30:06 user devstack@n-api.service[61871]: exception: Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e could not be found. Apr 13 15:30:06 user devstack@n-api.service[61871]: action_args: {'id': '75a68333-dc4d-48d9-84c6-4c7cd515853e'} Apr 13 15:30:06 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e could not be found. Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e could not be found. Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e could not be found. Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-e36f22c1-0db9-407e-a034-62b6e9058505 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Returning 404 to user: Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:30:06 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-e36f22c1-0db9-407e-a034-62b6e9058505 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e" status: 404 len: 111 microversion: 2.1 time: 0.050029 Apr 13 15:30:06 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 295/895] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:30:06 2023] DELETE /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:30:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-d708497a-bef3-46e0-a37d-c9d06d345272 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:30:06 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-d708497a-bef3-46e0-a37d-c9d06d345272 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:30:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d708497a-bef3-46e0-a37d-c9d06d345272 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d708497a-bef3-46e0-a37d-c9d06d345272 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d708497a-bef3-46e0-a37d-c9d06d345272 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d708497a-bef3-46e0-a37d-c9d06d345272 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d708497a-bef3-46e0-a37d-c9d06d345272 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d708497a-bef3-46e0-a37d-c9d06d345272 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:06 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-d708497a-bef3-46e0-a37d-c9d06d345272 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] HTTP exception thrown: Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e could not be found. Apr 13 15:30:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-d708497a-bef3-46e0-a37d-c9d06d345272 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Request method failure captured: Apr 13 15:30:06 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e HTTP/1.1 Apr 13 15:30:06 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:30:06 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:30:06 user devstack@n-api.service[61873]: Connection: close Apr 13 15:30:06 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:30:06 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:30:06 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:30:06 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:30:06 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:30:06 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBysJSC_pL1o3J9cVhCfPJH0RJxZJE2XjaF2Yq1nITqHQPAUJ-sY0C6ehk0hgyb5AGui4kwa-lWhEaqyW-11oCzt4s9SAjj7iiHUYBf3mDz8zQD6VpCcWxM23IvnmM9hydVYLDDtvrzvCJbTCSuVNPu3nJmaP7WJ6HL0s88zCkG70Us Apr 13 15:30:06 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:30:06 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:30:06 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:30:06 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:30:06 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:30:06 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:30:06 user devstack@n-api.service[61873]: X-Project-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:30:06 user devstack@n-api.service[61873]: X-Project-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:06 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:30:06 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:30:06 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:30:06 user devstack@n-api.service[61873]: X-Tenant: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:06 user devstack@n-api.service[61873]: X-Tenant-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:30:06 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:06 user devstack@n-api.service[61873]: X-User: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:30:06 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:30:06 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:30:06 user devstack@n-api.service[61873]: X-User-Id: fedd34ccc15c47f9a4fc96b080730acd Apr 13 15:30:06 user devstack@n-api.service[61873]: X-User-Name: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:30:06 user devstack@n-api.service[61873]: method: > Apr 13 15:30:06 user devstack@n-api.service[61873]: exception: Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e could not be found. Apr 13 15:30:06 user devstack@n-api.service[61873]: action_args: {'id': '75a68333-dc4d-48d9-84c6-4c7cd515853e'} Apr 13 15:30:06 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e could not be found. Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e could not be found. Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e could not be found. Apr 13 15:30:06 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-d708497a-bef3-46e0-a37d-c9d06d345272 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Returning 404 to user: Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:30:06 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-d708497a-bef3-46e0-a37d-c9d06d345272 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e" status: 404 len: 111 microversion: 2.1 time: 0.043522 Apr 13 15:30:06 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 301/896] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:30:06 2023] GET /compute/v2.1/servers/75a68333-dc4d-48d9-84c6-4c7cd515853e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:30:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-49b2bc0f-856d-4163-b3a3-b477e8c9fc15 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:30:06 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-49b2bc0f-856d-4163-b3a3-b477e8c9fc15 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:30:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-49b2bc0f-856d-4163-b3a3-b477e8c9fc15 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-49b2bc0f-856d-4163-b3a3-b477e8c9fc15 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-49b2bc0f-856d-4163-b3a3-b477e8c9fc15 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-49b2bc0f-856d-4163-b3a3-b477e8c9fc15 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-49b2bc0f-856d-4163-b3a3-b477e8c9fc15 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-49b2bc0f-856d-4163-b3a3-b477e8c9fc15 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:06 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-49b2bc0f-856d-4163-b3a3-b477e8c9fc15 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] HTTP exception thrown: Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 could not be found. Apr 13 15:30:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-49b2bc0f-856d-4163-b3a3-b477e8c9fc15 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Request method failure captured: Apr 13 15:30:06 user devstack@n-api.service[61872]: request: DELETE /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5 HTTP/1.1 Apr 13 15:30:06 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:30:06 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:30:06 user devstack@n-api.service[61872]: Connection: close Apr 13 15:30:06 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:30:06 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:30:06 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:30:06 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:30:06 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:30:06 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBysJSC_pL1o3J9cVhCfPJH0RJxZJE2XjaF2Yq1nITqHQPAUJ-sY0C6ehk0hgyb5AGui4kwa-lWhEaqyW-11oCzt4s9SAjj7iiHUYBf3mDz8zQD6VpCcWxM23IvnmM9hydVYLDDtvrzvCJbTCSuVNPu3nJmaP7WJ6HL0s88zCkG70Us Apr 13 15:30:06 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:30:06 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:30:06 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:30:06 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:30:06 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:30:06 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:30:06 user devstack@n-api.service[61872]: X-Project-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:30:06 user devstack@n-api.service[61872]: X-Project-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:06 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:30:06 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:30:06 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:30:06 user devstack@n-api.service[61872]: X-Tenant: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:06 user devstack@n-api.service[61872]: X-Tenant-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:30:06 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:06 user devstack@n-api.service[61872]: X-User: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:30:06 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:30:06 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:30:06 user devstack@n-api.service[61872]: X-User-Id: fedd34ccc15c47f9a4fc96b080730acd Apr 13 15:30:06 user devstack@n-api.service[61872]: X-User-Name: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:30:06 user devstack@n-api.service[61872]: method: > Apr 13 15:30:06 user devstack@n-api.service[61872]: exception: Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 could not be found. Apr 13 15:30:06 user devstack@n-api.service[61872]: action_args: {'id': '77237c63-ee05-45ee-b9d7-a79deb5557d5'} Apr 13 15:30:06 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 could not be found. Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 could not be found. Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 could not be found. Apr 13 15:30:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-49b2bc0f-856d-4163-b3a3-b477e8c9fc15 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Returning 404 to user: Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:30:06 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-49b2bc0f-856d-4163-b3a3-b477e8c9fc15 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5" status: 404 len: 111 microversion: 2.1 time: 0.032503 Apr 13 15:30:06 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 301/897] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:30:06 2023] DELETE /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-f59bcd5a-1c81-4d81-9506-ed2822114d90 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-f59bcd5a-1c81-4d81-9506-ed2822114d90 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f59bcd5a-1c81-4d81-9506-ed2822114d90 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f59bcd5a-1c81-4d81-9506-ed2822114d90 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f59bcd5a-1c81-4d81-9506-ed2822114d90 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f59bcd5a-1c81-4d81-9506-ed2822114d90 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f59bcd5a-1c81-4d81-9506-ed2822114d90 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f59bcd5a-1c81-4d81-9506-ed2822114d90 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:06 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-f59bcd5a-1c81-4d81-9506-ed2822114d90 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] HTTP exception thrown: Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 could not be found. Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-f59bcd5a-1c81-4d81-9506-ed2822114d90 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Request method failure captured: Apr 13 15:30:06 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5 HTTP/1.1 Apr 13 15:30:06 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:30:06 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:30:06 user devstack@n-api.service[61871]: Connection: close Apr 13 15:30:06 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:30:06 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:30:06 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:30:06 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:30:06 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBysJSC_pL1o3J9cVhCfPJH0RJxZJE2XjaF2Yq1nITqHQPAUJ-sY0C6ehk0hgyb5AGui4kwa-lWhEaqyW-11oCzt4s9SAjj7iiHUYBf3mDz8zQD6VpCcWxM23IvnmM9hydVYLDDtvrzvCJbTCSuVNPu3nJmaP7WJ6HL0s88zCkG70Us Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Project-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Project-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Tenant: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Tenant-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:30:06 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:06 user devstack@n-api.service[61871]: X-User: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:30:06 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:30:06 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:30:06 user devstack@n-api.service[61871]: X-User-Id: fedd34ccc15c47f9a4fc96b080730acd Apr 13 15:30:06 user devstack@n-api.service[61871]: X-User-Name: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:30:06 user devstack@n-api.service[61871]: method: > Apr 13 15:30:06 user devstack@n-api.service[61871]: exception: Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 could not be found. Apr 13 15:30:06 user devstack@n-api.service[61871]: action_args: {'id': '77237c63-ee05-45ee-b9d7-a79deb5557d5'} Apr 13 15:30:06 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 could not be found. Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 could not be found. Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 could not be found. Apr 13 15:30:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:30:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-f59bcd5a-1c81-4d81-9506-ed2822114d90 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Returning 404 to user: Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:30:06 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-f59bcd5a-1c81-4d81-9506-ed2822114d90 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5" status: 404 len: 111 microversion: 2.1 time: 0.033358 Apr 13 15:30:06 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 296/898] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:30:06 2023] GET /compute/v2.1/servers/77237c63-ee05-45ee-b9d7-a79deb5557d5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:30:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-4ccf45e6-cb89-46fd-b01b-1edb3ce710f6 req-7d14cca1-3f43-427d-831a-6de042573be3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9761101e-4bce-4e7b-8137-569bf8d27f87", "tag": "e2eabaa4-a35d-433f-850e-949af795e7ed"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:30:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-4ccf45e6-cb89-46fd-b01b-1edb3ce710f6 req-7d14cca1-3f43-427d-831a-6de042573be3 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-4ccf45e6-cb89-46fd-b01b-1edb3ce710f6 req-7d14cca1-3f43-427d-831a-6de042573be3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-4ccf45e6-cb89-46fd-b01b-1edb3ce710f6 req-7d14cca1-3f43-427d-831a-6de042573be3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:06 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-4ccf45e6-cb89-46fd-b01b-1edb3ce710f6 req-7d14cca1-3f43-427d-831a-6de042573be3 service nova] Creating event network-changed:e2eabaa4-a35d-433f-850e-949af795e7ed for instance 9761101e-4bce-4e7b-8137-569bf8d27f87 on user Apr 13 15:30:06 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-4ccf45e6-cb89-46fd-b01b-1edb3ce710f6 req-7d14cca1-3f43-427d-831a-6de042573be3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030137 Apr 13 15:30:06 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 302/899] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:30:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:30:07 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:30:07 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:30:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:07 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:07 user devstack@n-api.service[61872]: DEBUG nova.objects.instance [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'flavor' on Instance uuid 9761101e-4bce-4e7b-8137-569bf8d27f87 {{(pid=61872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:30:08 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-6085f038-28e8-411e-9cde-5a588895bfa0 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:30:08 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-6085f038-28e8-411e-9cde-5a588895bfa0 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:30:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6085f038-28e8-411e-9cde-5a588895bfa0 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6085f038-28e8-411e-9cde-5a588895bfa0 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6085f038-28e8-411e-9cde-5a588895bfa0 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6085f038-28e8-411e-9cde-5a588895bfa0 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6085f038-28e8-411e-9cde-5a588895bfa0 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6085f038-28e8-411e-9cde-5a588895bfa0 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:08 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-6085f038-28e8-411e-9cde-5a588895bfa0 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] HTTP exception thrown: Instance 3dc146f3-9150-4920-b468-9aebcbc81162 could not be found. Apr 13 15:30:08 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-6085f038-28e8-411e-9cde-5a588895bfa0 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Request method failure captured: Apr 13 15:30:08 user devstack@n-api.service[61871]: request: DELETE /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162 HTTP/1.1 Apr 13 15:30:08 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:30:08 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:30:08 user devstack@n-api.service[61871]: Connection: close Apr 13 15:30:08 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:30:08 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:30:08 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:30:08 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:30:08 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:30:08 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBysJSC_pL1o3J9cVhCfPJH0RJxZJE2XjaF2Yq1nITqHQPAUJ-sY0C6ehk0hgyb5AGui4kwa-lWhEaqyW-11oCzt4s9SAjj7iiHUYBf3mDz8zQD6VpCcWxM23IvnmM9hydVYLDDtvrzvCJbTCSuVNPu3nJmaP7WJ6HL0s88zCkG70Us Apr 13 15:30:08 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:30:08 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:30:08 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:30:08 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:30:08 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:30:08 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:30:08 user devstack@n-api.service[61871]: X-Project-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:30:08 user devstack@n-api.service[61871]: X-Project-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:08 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:30:08 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:30:08 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:30:08 user devstack@n-api.service[61871]: X-Tenant: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:08 user devstack@n-api.service[61871]: X-Tenant-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:30:08 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:08 user devstack@n-api.service[61871]: X-User: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:30:08 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:30:08 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:30:08 user devstack@n-api.service[61871]: X-User-Id: fedd34ccc15c47f9a4fc96b080730acd Apr 13 15:30:08 user devstack@n-api.service[61871]: X-User-Name: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:30:08 user devstack@n-api.service[61871]: method: > Apr 13 15:30:08 user devstack@n-api.service[61871]: exception: Instance 3dc146f3-9150-4920-b468-9aebcbc81162 could not be found. Apr 13 15:30:08 user devstack@n-api.service[61871]: action_args: {'id': '3dc146f3-9150-4920-b468-9aebcbc81162'} Apr 13 15:30:08 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc146f3-9150-4920-b468-9aebcbc81162 could not be found. Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc146f3-9150-4920-b468-9aebcbc81162 could not be found. Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc146f3-9150-4920-b468-9aebcbc81162 could not be found. Apr 13 15:30:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:30:08 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-6085f038-28e8-411e-9cde-5a588895bfa0 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Returning 404 to user: Instance 3dc146f3-9150-4920-b468-9aebcbc81162 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:30:08 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-6085f038-28e8-411e-9cde-5a588895bfa0 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162" status: 404 len: 111 microversion: 2.1 time: 0.030488 Apr 13 15:30:08 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 297/900] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:30:08 2023] DELETE /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:30:08 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-95ef3d84-7acb-43a6-94a0-15152ed97c00 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:30:08 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-95ef3d84-7acb-43a6-94a0-15152ed97c00 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:30:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-95ef3d84-7acb-43a6-94a0-15152ed97c00 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-95ef3d84-7acb-43a6-94a0-15152ed97c00 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-95ef3d84-7acb-43a6-94a0-15152ed97c00 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-95ef3d84-7acb-43a6-94a0-15152ed97c00 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-95ef3d84-7acb-43a6-94a0-15152ed97c00 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-95ef3d84-7acb-43a6-94a0-15152ed97c00 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:08 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-95ef3d84-7acb-43a6-94a0-15152ed97c00 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] HTTP exception thrown: Instance 3dc146f3-9150-4920-b468-9aebcbc81162 could not be found. Apr 13 15:30:08 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-95ef3d84-7acb-43a6-94a0-15152ed97c00 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Request method failure captured: Apr 13 15:30:08 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162 HTTP/1.1 Apr 13 15:30:08 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:30:08 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:30:08 user devstack@n-api.service[61873]: Connection: close Apr 13 15:30:08 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:30:08 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:30:08 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:30:08 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:30:08 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:30:08 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBysJSC_pL1o3J9cVhCfPJH0RJxZJE2XjaF2Yq1nITqHQPAUJ-sY0C6ehk0hgyb5AGui4kwa-lWhEaqyW-11oCzt4s9SAjj7iiHUYBf3mDz8zQD6VpCcWxM23IvnmM9hydVYLDDtvrzvCJbTCSuVNPu3nJmaP7WJ6HL0s88zCkG70Us Apr 13 15:30:08 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:30:08 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:30:08 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:30:08 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:30:08 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:30:08 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:30:08 user devstack@n-api.service[61873]: X-Project-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:30:08 user devstack@n-api.service[61873]: X-Project-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:08 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:30:08 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:30:08 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e3ba2d132c445039d0ae30ffd2bc64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:30:08 user devstack@n-api.service[61873]: X-Tenant: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:08 user devstack@n-api.service[61873]: X-Tenant-Id: 3e3ba2d132c445039d0ae30ffd2bc64a Apr 13 15:30:08 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-416139458 Apr 13 15:30:08 user devstack@n-api.service[61873]: X-User: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:30:08 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:30:08 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:30:08 user devstack@n-api.service[61873]: X-User-Id: fedd34ccc15c47f9a4fc96b080730acd Apr 13 15:30:08 user devstack@n-api.service[61873]: X-User-Name: tempest-AttachVolumeNegativeTest-416139458-project-member Apr 13 15:30:08 user devstack@n-api.service[61873]: method: > Apr 13 15:30:08 user devstack@n-api.service[61873]: exception: Instance 3dc146f3-9150-4920-b468-9aebcbc81162 could not be found. Apr 13 15:30:08 user devstack@n-api.service[61873]: action_args: {'id': '3dc146f3-9150-4920-b468-9aebcbc81162'} Apr 13 15:30:08 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc146f3-9150-4920-b468-9aebcbc81162 could not be found. Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc146f3-9150-4920-b468-9aebcbc81162 could not be found. Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc146f3-9150-4920-b468-9aebcbc81162 could not be found. Apr 13 15:30:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:08 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-95ef3d84-7acb-43a6-94a0-15152ed97c00 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Returning 404 to user: Instance 3dc146f3-9150-4920-b468-9aebcbc81162 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:30:08 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-95ef3d84-7acb-43a6-94a0-15152ed97c00 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162" status: 404 len: 111 microversion: 2.1 time: 0.030159 Apr 13 15:30:08 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 303/901] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:30:08 2023] GET /compute/v2.1/servers/3dc146f3-9150-4920-b468-9aebcbc81162 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:30:08 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87/action" status: 202 len: 0 microversion: 2.20 time: 1.087253 Apr 13 15:30:08 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 302/902] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 15:30:07 2023] POST /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87/action => generated 0 bytes in 1089 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:30:08 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-f3e3b12b-ff10-424e-8a8a-b677e8aceb82 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:30:08 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-f3e3b12b-ff10-424e-8a8a-b677e8aceb82 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:30:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f3e3b12b-ff10-424e-8a8a-b677e8aceb82 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f3e3b12b-ff10-424e-8a8a-b677e8aceb82 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f3e3b12b-ff10-424e-8a8a-b677e8aceb82 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f3e3b12b-ff10-424e-8a8a-b677e8aceb82 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f3e3b12b-ff10-424e-8a8a-b677e8aceb82 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f3e3b12b-ff10-424e-8a8a-b677e8aceb82 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:09 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-f3e3b12b-ff10-424e-8a8a-b677e8aceb82 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:30:09 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-f3e3b12b-ff10-424e-8a8a-b677e8aceb82 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:30:09 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-f3e3b12b-ff10-424e-8a8a-b677e8aceb82 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:30:09 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-f3e3b12b-ff10-424e-8a8a-b677e8aceb82 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87" status: 200 len: 1712 microversion: 2.20 time: 0.238159 Apr 13 15:30:09 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 298/903] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:30:08 2023] GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87 => generated 1712 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:30:09 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-2bbf3c37-f834-49b0-872d-32aa38afdae2 req-f2a74b66-706b-4570-bb2b-4dff1167a4c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9761101e-4bce-4e7b-8137-569bf8d27f87", "name": "network-vif-unplugged", "status": "completed", "tag": "e2eabaa4-a35d-433f-850e-949af795e7ed"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:30:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-2bbf3c37-f834-49b0-872d-32aa38afdae2 req-f2a74b66-706b-4570-bb2b-4dff1167a4c1 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-2bbf3c37-f834-49b0-872d-32aa38afdae2 req-f2a74b66-706b-4570-bb2b-4dff1167a4c1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-2bbf3c37-f834-49b0-872d-32aa38afdae2 req-f2a74b66-706b-4570-bb2b-4dff1167a4c1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:09 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-2bbf3c37-f834-49b0-872d-32aa38afdae2 req-f2a74b66-706b-4570-bb2b-4dff1167a4c1 service nova] Creating event network-vif-unplugged:e2eabaa4-a35d-433f-850e-949af795e7ed for instance 9761101e-4bce-4e7b-8137-569bf8d27f87 on user Apr 13 15:30:09 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-2bbf3c37-f834-49b0-872d-32aa38afdae2 req-f2a74b66-706b-4570-bb2b-4dff1167a4c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031373 Apr 13 15:30:09 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 304/904] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:30:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:30:11 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-a586d3bb-87d4-4567-bdc9-15abbf5bd12a req-29a8bd19-b8c4-4cd5-aa56-b1ba57fad2fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9761101e-4bce-4e7b-8137-569bf8d27f87", "name": "network-vif-plugged", "status": "completed", "tag": "e2eabaa4-a35d-433f-850e-949af795e7ed"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:30:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a586d3bb-87d4-4567-bdc9-15abbf5bd12a req-29a8bd19-b8c4-4cd5-aa56-b1ba57fad2fb service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a586d3bb-87d4-4567-bdc9-15abbf5bd12a req-29a8bd19-b8c4-4cd5-aa56-b1ba57fad2fb service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a586d3bb-87d4-4567-bdc9-15abbf5bd12a req-29a8bd19-b8c4-4cd5-aa56-b1ba57fad2fb service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:11 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-a586d3bb-87d4-4567-bdc9-15abbf5bd12a req-29a8bd19-b8c4-4cd5-aa56-b1ba57fad2fb service nova] Creating event network-vif-plugged:e2eabaa4-a35d-433f-850e-949af795e7ed for instance 9761101e-4bce-4e7b-8137-569bf8d27f87 on user Apr 13 15:30:11 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-a586d3bb-87d4-4567-bdc9-15abbf5bd12a req-29a8bd19-b8c4-4cd5-aa56-b1ba57fad2fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031891 Apr 13 15:30:11 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 303/905] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:30:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:30:14 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-e01fedeb-ccd5-4962-b231-d5e904d30889 req-f720f729-9ffd-4774-a770-a96cbb3e97b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9761101e-4bce-4e7b-8137-569bf8d27f87", "tag": "e2eabaa4-a35d-433f-850e-949af795e7ed"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:30:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-e01fedeb-ccd5-4962-b231-d5e904d30889 req-f720f729-9ffd-4774-a770-a96cbb3e97b5 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-e01fedeb-ccd5-4962-b231-d5e904d30889 req-f720f729-9ffd-4774-a770-a96cbb3e97b5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:14 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-e01fedeb-ccd5-4962-b231-d5e904d30889 req-f720f729-9ffd-4774-a770-a96cbb3e97b5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:14 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-e01fedeb-ccd5-4962-b231-d5e904d30889 req-f720f729-9ffd-4774-a770-a96cbb3e97b5 service nova] Creating event network-changed:e2eabaa4-a35d-433f-850e-949af795e7ed for instance 9761101e-4bce-4e7b-8137-569bf8d27f87 on user Apr 13 15:30:14 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-e01fedeb-ccd5-4962-b231-d5e904d30889 req-f720f729-9ffd-4774-a770-a96cbb3e97b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035843 Apr 13 15:30:14 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 299/906] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:30:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:30:40 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=24 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:30:40 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=36 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:30:40 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-4055c8be-2bdd-4465-80cf-3195bc029d13 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:30:40 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-4055c8be-2bdd-4465-80cf-3195bc029d13 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:30:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4055c8be-2bdd-4465-80cf-3195bc029d13 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4055c8be-2bdd-4465-80cf-3195bc029d13 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4055c8be-2bdd-4465-80cf-3195bc029d13 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4055c8be-2bdd-4465-80cf-3195bc029d13 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4055c8be-2bdd-4465-80cf-3195bc029d13 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4055c8be-2bdd-4465-80cf-3195bc029d13 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:40 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-4055c8be-2bdd-4465-80cf-3195bc029d13 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:30:40 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-4055c8be-2bdd-4465-80cf-3195bc029d13 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643" status: 200 len: 1553 microversion: 2.1 time: 0.213385 Apr 13 15:30:40 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 305/907] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:30:40 2023] GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643 => generated 1553 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:30:46 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-f95c2bd7-db91-419d-bf5a-55a70558d3cc tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:30:46 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-f95c2bd7-db91-419d-bf5a-55a70558d3cc tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:30:46 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:30:46 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:30:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f95c2bd7-db91-419d-bf5a-55a70558d3cc tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f95c2bd7-db91-419d-bf5a-55a70558d3cc tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f95c2bd7-db91-419d-bf5a-55a70558d3cc tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f95c2bd7-db91-419d-bf5a-55a70558d3cc tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f95c2bd7-db91-419d-bf5a-55a70558d3cc tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:46 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-f95c2bd7-db91-419d-bf5a-55a70558d3cc tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:46 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-f95c2bd7-db91-419d-bf5a-55a70558d3cc tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] HTTP exception thrown: Instance 42464137-e247-4191-8ed4-4bbdbe392f95 could not be found. Apr 13 15:30:46 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-f95c2bd7-db91-419d-bf5a-55a70558d3cc tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Request method failure captured: Apr 13 15:30:46 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95 HTTP/1.1 Apr 13 15:30:46 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:30:46 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:30:46 user devstack@n-api.service[61872]: Connection: close Apr 13 15:30:46 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:30:46 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:30:46 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:30:46 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:30:46 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:30:46 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOB5OYmV_Z7cVduDWwcEQSUOMRC6fZpwzm9bPif3HSL9IVY4_EjdZIcicpg0m6gcsnicTqRoct8b5KUmxHGHwiiCI36SOarDBJPsO8WZ2gL0x-PlYfI5IHad6ioIceXEnljoLM3heCTWMqsoEHoIwNVrOTP-oyVu-mulzBjEyx-WwxNE Apr 13 15:30:46 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:30:46 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:30:46 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:30:46 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:30:46 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:30:46 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:30:46 user devstack@n-api.service[61872]: X-Project-Id: 318b9e0eb6a745df811d1daa4d6195fc Apr 13 15:30:46 user devstack@n-api.service[61872]: X-Project-Name: tempest-TestStampPattern-1572934421 Apr 13 15:30:46 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:30:46 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:30:46 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/318b9e0eb6a745df811d1daa4d6195fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/318b9e0eb6a745df811d1daa4d6195fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/318b9e0eb6a745df811d1daa4d6195fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:30:46 user devstack@n-api.service[61872]: X-Tenant: tempest-TestStampPattern-1572934421 Apr 13 15:30:46 user devstack@n-api.service[61872]: X-Tenant-Id: 318b9e0eb6a745df811d1daa4d6195fc Apr 13 15:30:46 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-TestStampPattern-1572934421 Apr 13 15:30:46 user devstack@n-api.service[61872]: X-User: tempest-TestStampPattern-1572934421-project-member Apr 13 15:30:46 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:30:46 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:30:46 user devstack@n-api.service[61872]: X-User-Id: 78e289648c244c77ab9ca48154da3cde Apr 13 15:30:46 user devstack@n-api.service[61872]: X-User-Name: tempest-TestStampPattern-1572934421-project-member Apr 13 15:30:46 user devstack@n-api.service[61872]: method: > Apr 13 15:30:46 user devstack@n-api.service[61872]: exception: Instance 42464137-e247-4191-8ed4-4bbdbe392f95 could not be found. Apr 13 15:30:46 user devstack@n-api.service[61872]: action_args: {'id': '42464137-e247-4191-8ed4-4bbdbe392f95'} Apr 13 15:30:46 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42464137-e247-4191-8ed4-4bbdbe392f95 could not be found. Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42464137-e247-4191-8ed4-4bbdbe392f95 could not be found. Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42464137-e247-4191-8ed4-4bbdbe392f95 could not be found. Apr 13 15:30:46 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:30:46 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-f95c2bd7-db91-419d-bf5a-55a70558d3cc tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Returning 404 to user: Instance 42464137-e247-4191-8ed4-4bbdbe392f95 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:30:46 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-f95c2bd7-db91-419d-bf5a-55a70558d3cc tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95" status: 404 len: 111 microversion: 2.1 time: 0.038379 Apr 13 15:30:46 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 304/908] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:30:46 2023] GET /compute/v2.1/servers/42464137-e247-4191-8ed4-4bbdbe392f95 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:30:48 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:30:48 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:30:48 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-43a82933-b4a5-44d1-9aa7-7cd03fba27f4 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Calling method '.version_select at 0x7f3a8f877130>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:30:48 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-43a82933-b4a5-44d1-9aa7-7cd03fba27f4 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1982719940" status: 202 len: 0 microversion: 2.1 time: 0.034538 Apr 13 15:30:48 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 300/909] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 15:30:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1982719940 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:30:57 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-784045192", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "d3d4769d-f892-4cea-b640-216f5f23b184", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3"}]}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:30:57 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:30:57 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:30:57 user devstack@n-api.service[61873]: DEBUG nova.network.neutron [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] validate_networks() for [('66ea8c1a-1c77-4a2a-ab35-64acac4762c3', None, None, None, None, None)] {{(pid=61873) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:30:57 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:30:57 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:30:57 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:30:57 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:30:57 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:30:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:58 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:58 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting quotas for project d5d7f771264c4cd2bc595a2c525082d0. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:30:58 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting quotas for user 0307fb8d127a41079e34355904352231 and project d5d7f771264c4cd2bc595a2c525082d0. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:30:58 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Going to run 1 instances... {{(pid=61873) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:30:58 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d3d4769d-f892-4cea-b640-216f5f23b184',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:30:58 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.589662 Apr 13 15:30:58 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 306/910] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:30:57 2023] POST /compute/v2.1/servers => generated 378 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:30:58 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-fa2ff914-326d-4e5a-9770-40d3bb4abdff tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:30:58 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-fa2ff914-326d-4e5a-9770-40d3bb4abdff tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:30:58 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:30:58 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-fa2ff914-326d-4e5a-9770-40d3bb4abdff tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:30:58 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-fa2ff914-326d-4e5a-9770-40d3bb4abdff tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f" status: 200 len: 1051 microversion: 2.1 time: 0.066717 Apr 13 15:30:58 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 305/911] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:30:58 2023] GET /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f => generated 1051 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:30:59 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-84f784fa-c766-4904-bc0b-f8e7c0af7949 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:30:59 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-84f784fa-c766-4904-bc0b-f8e7c0af7949 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:30:59 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:30:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-84f784fa-c766-4904-bc0b-f8e7c0af7949 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-84f784fa-c766-4904-bc0b-f8e7c0af7949 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-84f784fa-c766-4904-bc0b-f8e7c0af7949 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-84f784fa-c766-4904-bc0b-f8e7c0af7949 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-84f784fa-c766-4904-bc0b-f8e7c0af7949 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-84f784fa-c766-4904-bc0b-f8e7c0af7949 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:59 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-ec3a8313-1580-42c0-b855-6d8f9a0fabd3 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-114734399", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "0ed9ca99-2e7c-4a5f-946f-c19f829510d3", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "8c2be808-8e48-40ed-8182-2243a199bf06"}]}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:30:59 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-84f784fa-c766-4904-bc0b-f8e7c0af7949 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:30:59 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-84f784fa-c766-4904-bc0b-f8e7c0af7949 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:30:59 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-84f784fa-c766-4904-bc0b-f8e7c0af7949 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:30:59 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-84f784fa-c766-4904-bc0b-f8e7c0af7949 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87" status: 200 len: 1653 microversion: 2.20 time: 0.177335 Apr 13 15:30:59 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 301/912] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:30:59 2023] GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87 => generated 1653 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:30:59 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-ec3a8313-1580-42c0-b855-6d8f9a0fabd3 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] HTTP exception thrown: Block Device 0ed9ca99-2e7c-4a5f-946f-c19f829510d3 is not bootable. Apr 13 15:30:59 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-ec3a8313-1580-42c0-b855-6d8f9a0fabd3 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Request method failure captured: Apr 13 15:30:59 user devstack@n-api.service[61873]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 13 15:30:59 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:30:59 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:30:59 user devstack@n-api.service[61873]: Connection: close Apr 13 15:30:59 user devstack@n-api.service[61873]: Content-Length: 356 Apr 13 15:30:59 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:30:59 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:30:59 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:30:59 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:30:59 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOB7kKQ44jHGyRwLCnKetXuptxn0znpv1SCvdmpcfSLebOWuTJbaDmT9s8_KTZV_Nzw6Nf9PmJBaiMYXvtuNBpo17X0Kcfru9DbFvcC33q8yjZQ1ouKJDxhQ0wQ0H-ndflDRipvny3s7y8abf-HRxzRrh7eJlHlgT1EnBB5Pboqyao0A Apr 13 15:30:59 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:30:59 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:30:59 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:30:59 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:30:59 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:30:59 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:30:59 user devstack@n-api.service[61873]: X-Project-Id: 1ac07b9454744832b26bf6bd126763ec Apr 13 15:30:59 user devstack@n-api.service[61873]: X-Project-Name: tempest-ServersNegativeTestJSON-187650290 Apr 13 15:30:59 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:30:59 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:30:59 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1ac07b9454744832b26bf6bd126763ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ac07b9454744832b26bf6bd126763ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ac07b9454744832b26bf6bd126763ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:30:59 user devstack@n-api.service[61873]: X-Tenant: tempest-ServersNegativeTestJSON-187650290 Apr 13 15:30:59 user devstack@n-api.service[61873]: X-Tenant-Id: 1ac07b9454744832b26bf6bd126763ec Apr 13 15:30:59 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187650290 Apr 13 15:30:59 user devstack@n-api.service[61873]: X-User: tempest-ServersNegativeTestJSON-187650290-project-member Apr 13 15:30:59 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:30:59 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:30:59 user devstack@n-api.service[61873]: X-User-Id: 3a6955546e4f4292a25acad709d27953 Apr 13 15:30:59 user devstack@n-api.service[61873]: X-User-Name: tempest-ServersNegativeTestJSON-187650290-project-member Apr 13 15:30:59 user devstack@n-api.service[61873]: Apr 13 15:30:59 user devstack@n-api.service[61873]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-114734399", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "0ed9ca99-2e7c-4a5f-946f-c19f829510d3", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "8c2be808-8e48-40ed-8182-2243a199bf06"}]}} Apr 13 15:30:59 user devstack@n-api.service[61873]: method: > Apr 13 15:30:59 user devstack@n-api.service[61873]: exception: Block Device 0ed9ca99-2e7c-4a5f-946f-c19f829510d3 is not bootable. Apr 13 15:30:59 user devstack@n-api.service[61873]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-114734399', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '0ed9ca99-2e7c-4a5f-946f-c19f829510d3'}], 'networks': [{'uuid': '8c2be808-8e48-40ed-8182-2243a199bf06'}]}}} Apr 13 15:30:59 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 0ed9ca99-2e7c-4a5f-946f-c19f829510d3 is not bootable. Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 0ed9ca99-2e7c-4a5f-946f-c19f829510d3 is not bootable. Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 0ed9ca99-2e7c-4a5f-946f-c19f829510d3 is not bootable. Apr 13 15:30:59 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:30:59 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-ec3a8313-1580-42c0-b855-6d8f9a0fabd3 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Returning 400 to user: Block Device 0ed9ca99-2e7c-4a5f-946f-c19f829510d3 is not bootable. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:30:59 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-ec3a8313-1580-42c0-b855-6d8f9a0fabd3 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.090815 Apr 13 15:30:59 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 307/913] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:30:59 2023] POST /compute/v2.1/servers => generated 110 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:30:59 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-c521698e-48bf-4d28-bc70-5196c548c213 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:30:59 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-c521698e-48bf-4d28-bc70-5196c548c213 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:30:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c521698e-48bf-4d28-bc70-5196c548c213 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c521698e-48bf-4d28-bc70-5196c548c213 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c521698e-48bf-4d28-bc70-5196c548c213 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c521698e-48bf-4d28-bc70-5196c548c213 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:30:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c521698e-48bf-4d28-bc70-5196c548c213 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:30:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c521698e-48bf-4d28-bc70-5196c548c213 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:30:59 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-c521698e-48bf-4d28-bc70-5196c548c213 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6955546e4f4292a25acad709d27953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac07b9454744832b26bf6bd126763ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:30:59 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-c521698e-48bf-4d28-bc70-5196c548c213 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22bb22bd-efa8-4679-979a-dd0ce28a79e3" status: 200 len: 1493 microversion: 2.1 time: 0.249061 Apr 13 15:30:59 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 306/914] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:30:59 2023] GET /compute/v2.1/servers/22bb22bd-efa8-4679-979a-dd0ce28a79e3 => generated 1493 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:31:00 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-f091bc09-ccad-4cf1-bc28-51532978a8db req-ef7c9fee-05cc-45b4-8c88-2f29becee593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8082f405-f0bd-4889-ba90-26350f262c4f", "tag": "d32c2601-e479-49c2-a7bf-4d7bd00138af"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:31:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-f091bc09-ccad-4cf1-bc28-51532978a8db req-ef7c9fee-05cc-45b4-8c88-2f29becee593 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:31:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-f091bc09-ccad-4cf1-bc28-51532978a8db req-ef7c9fee-05cc-45b4-8c88-2f29becee593 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:31:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-f091bc09-ccad-4cf1-bc28-51532978a8db req-ef7c9fee-05cc-45b4-8c88-2f29becee593 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:31:00 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-f091bc09-ccad-4cf1-bc28-51532978a8db req-ef7c9fee-05cc-45b4-8c88-2f29becee593 service nova] Creating event network-changed:d32c2601-e479-49c2-a7bf-4d7bd00138af for instance 8082f405-f0bd-4889-ba90-26350f262c4f on user Apr 13 15:31:00 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-f091bc09-ccad-4cf1-bc28-51532978a8db req-ef7c9fee-05cc-45b4-8c88-2f29becee593 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046202 Apr 13 15:31:00 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 302/915] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:31:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:31:14 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:31:14 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:31:14 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:31:14 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:31:14 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-568eb2c2-a468-462e-9bd2-6656e12e6fed req-cafa5b83-0eec-4b56-86df-98e8ee003a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8082f405-f0bd-4889-ba90-26350f262c4f", "name": "network-vif-plugged", "status": "completed", "tag": "d32c2601-e479-49c2-a7bf-4d7bd00138af"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:31:14 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-568eb2c2-a468-462e-9bd2-6656e12e6fed req-cafa5b83-0eec-4b56-86df-98e8ee003a85 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:31:14 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-568eb2c2-a468-462e-9bd2-6656e12e6fed req-cafa5b83-0eec-4b56-86df-98e8ee003a85 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:31:14 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-568eb2c2-a468-462e-9bd2-6656e12e6fed req-cafa5b83-0eec-4b56-86df-98e8ee003a85 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:31:14 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-568eb2c2-a468-462e-9bd2-6656e12e6fed req-cafa5b83-0eec-4b56-86df-98e8ee003a85 service nova] Creating event network-vif-plugged:d32c2601-e479-49c2-a7bf-4d7bd00138af for instance 8082f405-f0bd-4889-ba90-26350f262c4f on user Apr 13 15:31:14 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-568eb2c2-a468-462e-9bd2-6656e12e6fed req-cafa5b83-0eec-4b56-86df-98e8ee003a85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100081 Apr 13 15:31:14 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 308/916] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:31:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:31:16 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-12364d1f-e301-41d6-9bfe-e1310742c404 req-6930d3d5-b212-4e90-a0d3-c62d7f56b622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8082f405-f0bd-4889-ba90-26350f262c4f", "name": "network-vif-plugged", "status": "completed", "tag": "d32c2601-e479-49c2-a7bf-4d7bd00138af"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:31:16 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:31:16 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:31:16 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=8 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:31:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-12364d1f-e301-41d6-9bfe-e1310742c404 req-6930d3d5-b212-4e90-a0d3-c62d7f56b622 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:31:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-12364d1f-e301-41d6-9bfe-e1310742c404 req-6930d3d5-b212-4e90-a0d3-c62d7f56b622 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:31:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-12364d1f-e301-41d6-9bfe-e1310742c404 req-6930d3d5-b212-4e90-a0d3-c62d7f56b622 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:31:16 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-12364d1f-e301-41d6-9bfe-e1310742c404 req-6930d3d5-b212-4e90-a0d3-c62d7f56b622 service nova] Creating event network-vif-plugged:d32c2601-e479-49c2-a7bf-4d7bd00138af for instance 8082f405-f0bd-4889-ba90-26350f262c4f on user Apr 13 15:31:16 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-12364d1f-e301-41d6-9bfe-e1310742c404 req-6930d3d5-b212-4e90-a0d3-c62d7f56b622 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039067 Apr 13 15:31:16 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 307/917] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:31:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:31:40 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=4 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:31:40 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=8 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:31:40 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:31:40 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:31:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:31:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:31:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:31:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:31:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:31:40 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:31:40 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643/action" status: 204 len: 0 microversion: 2.1 time: 0.076568 Apr 13 15:31:40 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 303/918] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:31:40 2023] POST /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:31:40 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:31:40 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:31:40 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-8a097e7f-1420-4a43-ac76-b448f12d1be7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:31:40 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-8a097e7f-1420-4a43-ac76-b448f12d1be7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:31:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8a097e7f-1420-4a43-ac76-b448f12d1be7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:31:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8a097e7f-1420-4a43-ac76-b448f12d1be7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:31:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8a097e7f-1420-4a43-ac76-b448f12d1be7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:31:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8a097e7f-1420-4a43-ac76-b448f12d1be7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:31:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8a097e7f-1420-4a43-ac76-b448f12d1be7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:31:40 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8a097e7f-1420-4a43-ac76-b448f12d1be7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:31:40 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-8a097e7f-1420-4a43-ac76-b448f12d1be7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:31:40 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-8a097e7f-1420-4a43-ac76-b448f12d1be7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643" status: 200 len: 1553 microversion: 2.1 time: 0.209004 Apr 13 15:31:40 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 309/919] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:31:40 2023] GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643 => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:31:48 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:31:48 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:31:48 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-67a48984-1ed0-44a4-8c24-7470b37409cb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:31:48 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-67a48984-1ed0-44a4-8c24-7470b37409cb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:31:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-67a48984-1ed0-44a4-8c24-7470b37409cb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:31:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-67a48984-1ed0-44a4-8c24-7470b37409cb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:31:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-67a48984-1ed0-44a4-8c24-7470b37409cb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:31:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-67a48984-1ed0-44a4-8c24-7470b37409cb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:31:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-67a48984-1ed0-44a4-8c24-7470b37409cb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:31:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-67a48984-1ed0-44a4-8c24-7470b37409cb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:31:48 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-67a48984-1ed0-44a4-8c24-7470b37409cb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:31:48 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-67a48984-1ed0-44a4-8c24-7470b37409cb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f" status: 200 len: 1377 microversion: 2.1 time: 0.300295 Apr 13 15:31:48 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 308/920] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:31:48 2023] GET /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f => generated 1377 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:31:59 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:31:59 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:31:59 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-600ac18e-6c9a-406e-aeb5-d3f3aa804af8 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37b94d35-9939-4ebd-989f-49669dd5ce82"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:31:59 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-600ac18e-6c9a-406e-aeb5-d3f3aa804af8 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:31:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-600ac18e-6c9a-406e-aeb5-d3f3aa804af8 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:31:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-600ac18e-6c9a-406e-aeb5-d3f3aa804af8 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:31:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-600ac18e-6c9a-406e-aeb5-d3f3aa804af8 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:31:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-600ac18e-6c9a-406e-aeb5-d3f3aa804af8 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:31:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-600ac18e-6c9a-406e-aeb5-d3f3aa804af8 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:31:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-600ac18e-6c9a-406e-aeb5-d3f3aa804af8 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:31:59 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-9da6836c-2607-4b56-b8e0-ba4a6eee468d tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:31:59 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-9da6836c-2607-4b56-b8e0-ba4a6eee468d tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:31:59 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:31:59 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:31:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9da6836c-2607-4b56-b8e0-ba4a6eee468d tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:31:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9da6836c-2607-4b56-b8e0-ba4a6eee468d tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:31:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9da6836c-2607-4b56-b8e0-ba4a6eee468d tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:31:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9da6836c-2607-4b56-b8e0-ba4a6eee468d tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:31:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9da6836c-2607-4b56-b8e0-ba4a6eee468d tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:31:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9da6836c-2607-4b56-b8e0-ba4a6eee468d tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:31:59 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-600ac18e-6c9a-406e-aeb5-d3f3aa804af8 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.334224 Apr 13 15:31:59 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 304/921] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 15:31:59 2023] POST /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87/os-volume_attachments => generated 188 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:31:59 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:31:59 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-9da6836c-2607-4b56-b8e0-ba4a6eee468d tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6955546e4f4292a25acad709d27953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac07b9454744832b26bf6bd126763ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:31:59 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:31:59 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:31:59 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:31:59 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-9da6836c-2607-4b56-b8e0-ba4a6eee468d tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22bb22bd-efa8-4679-979a-dd0ce28a79e3" status: 200 len: 1493 microversion: 2.1 time: 0.178479 Apr 13 15:31:59 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 310/922] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:31:59 2023] GET /compute/v2.1/servers/22bb22bd-efa8-4679-979a-dd0ce28a79e3 => generated 1493 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:31:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:31:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:00 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:00 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:00 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:00 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:00 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61872) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 15:32:00 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87/action" status: 202 len: 0 microversion: 2.20 time: 0.125202 Apr 13 15:32:00 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 309/923] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 15:31:59 2023] POST /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:32:00 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-0be1df8f-ad87-4588-aa26-a57d5663fdb9 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:32:00 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-0be1df8f-ad87-4588-aa26-a57d5663fdb9 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:32:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0be1df8f-ad87-4588-aa26-a57d5663fdb9 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0be1df8f-ad87-4588-aa26-a57d5663fdb9 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0be1df8f-ad87-4588-aa26-a57d5663fdb9 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0be1df8f-ad87-4588-aa26-a57d5663fdb9 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0be1df8f-ad87-4588-aa26-a57d5663fdb9 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-0be1df8f-ad87-4588-aa26-a57d5663fdb9 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:00 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-0be1df8f-ad87-4588-aa26-a57d5663fdb9 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:32:00 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-0be1df8f-ad87-4588-aa26-a57d5663fdb9 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:32:00 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-0be1df8f-ad87-4588-aa26-a57d5663fdb9 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:32:00 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-0be1df8f-ad87-4588-aa26-a57d5663fdb9 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87" status: 200 len: 1739 microversion: 2.20 time: 0.142185 Apr 13 15:32:00 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 305/924] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:32:00 2023] GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87 => generated 1739 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:32:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-390f8696-ca85-405f-bc03-8abd00747f19 req-471cfb75-d762-4c6e-85a7-4a28c7cb2275 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9761101e-4bce-4e7b-8137-569bf8d27f87", "tag": "e2eabaa4-a35d-433f-850e-949af795e7ed"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:32:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-390f8696-ca85-405f-bc03-8abd00747f19 req-471cfb75-d762-4c6e-85a7-4a28c7cb2275 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-390f8696-ca85-405f-bc03-8abd00747f19 req-471cfb75-d762-4c6e-85a7-4a28c7cb2275 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-390f8696-ca85-405f-bc03-8abd00747f19 req-471cfb75-d762-4c6e-85a7-4a28c7cb2275 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:06 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-390f8696-ca85-405f-bc03-8abd00747f19 req-471cfb75-d762-4c6e-85a7-4a28c7cb2275 service nova] Creating event network-changed:e2eabaa4-a35d-433f-850e-949af795e7ed for instance 9761101e-4bce-4e7b-8137-569bf8d27f87 on user Apr 13 15:32:06 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-390f8696-ca85-405f-bc03-8abd00747f19 req-471cfb75-d762-4c6e-85a7-4a28c7cb2275 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030501 Apr 13 15:32:06 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 311/925] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:32:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:32:14 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=6,nova_api:UPDATE=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:32:14 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:32:14 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-1b675258-d5ab-43cf-a7f8-590e6241d93d req-d301f5e2-4d37-4969-8043-42d188e7d437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9761101e-4bce-4e7b-8137-569bf8d27f87", "name": "network-vif-plugged", "status": "completed", "tag": "e2eabaa4-a35d-433f-850e-949af795e7ed"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:32:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-1b675258-d5ab-43cf-a7f8-590e6241d93d req-d301f5e2-4d37-4969-8043-42d188e7d437 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-1b675258-d5ab-43cf-a7f8-590e6241d93d req-d301f5e2-4d37-4969-8043-42d188e7d437 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-1b675258-d5ab-43cf-a7f8-590e6241d93d req-d301f5e2-4d37-4969-8043-42d188e7d437 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:14 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-1b675258-d5ab-43cf-a7f8-590e6241d93d req-d301f5e2-4d37-4969-8043-42d188e7d437 service nova] Creating event network-vif-plugged:e2eabaa4-a35d-433f-850e-949af795e7ed for instance 9761101e-4bce-4e7b-8137-569bf8d27f87 on user Apr 13 15:32:14 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-1b675258-d5ab-43cf-a7f8-590e6241d93d req-d301f5e2-4d37-4969-8043-42d188e7d437 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043879 Apr 13 15:32:14 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 310/926] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:32:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:32:16 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-f9c3fa73-314f-4083-a49e-64dbc26810b0 req-95d57572-85e3-4285-a144-62da5ae5e31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9761101e-4bce-4e7b-8137-569bf8d27f87", "name": "network-vif-plugged", "status": "completed", "tag": "e2eabaa4-a35d-433f-850e-949af795e7ed"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:32:16 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=4 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:32:16 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:32:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-f9c3fa73-314f-4083-a49e-64dbc26810b0 req-95d57572-85e3-4285-a144-62da5ae5e31d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-f9c3fa73-314f-4083-a49e-64dbc26810b0 req-95d57572-85e3-4285-a144-62da5ae5e31d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-f9c3fa73-314f-4083-a49e-64dbc26810b0 req-95d57572-85e3-4285-a144-62da5ae5e31d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:16 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-f9c3fa73-314f-4083-a49e-64dbc26810b0 req-95d57572-85e3-4285-a144-62da5ae5e31d service nova] Creating event network-vif-plugged:e2eabaa4-a35d-433f-850e-949af795e7ed for instance 9761101e-4bce-4e7b-8137-569bf8d27f87 on user Apr 13 15:32:16 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-f9c3fa73-314f-4083-a49e-64dbc26810b0 req-95d57572-85e3-4285-a144-62da5ae5e31d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033242 Apr 13 15:32:16 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 306/927] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:32:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:32:30 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-cd25991b-4be0-4455-a91b-e748bff7f288 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:32:30 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-cd25991b-4be0-4455-a91b-e748bff7f288 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:32:30 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:32:30 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=8 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:32:30 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cd25991b-4be0-4455-a91b-e748bff7f288 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:30 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cd25991b-4be0-4455-a91b-e748bff7f288 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:30 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cd25991b-4be0-4455-a91b-e748bff7f288 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:30 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cd25991b-4be0-4455-a91b-e748bff7f288 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:30 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cd25991b-4be0-4455-a91b-e748bff7f288 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:30 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-cd25991b-4be0-4455-a91b-e748bff7f288 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:30 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-cd25991b-4be0-4455-a91b-e748bff7f288 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:32:31 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-cd25991b-4be0-4455-a91b-e748bff7f288 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643" status: 200 len: 1545 microversion: 2.1 time: 0.206095 Apr 13 15:32:31 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 312/928] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:32:30 2023] GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643 => generated 1545 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:32:48 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-a4a71903-9f93-4081-9389-1d3e496a4a34 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:32:48 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-a4a71903-9f93-4081-9389-1d3e496a4a34 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:32:48 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:32:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a4a71903-9f93-4081-9389-1d3e496a4a34 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a4a71903-9f93-4081-9389-1d3e496a4a34 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a4a71903-9f93-4081-9389-1d3e496a4a34 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a4a71903-9f93-4081-9389-1d3e496a4a34 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a4a71903-9f93-4081-9389-1d3e496a4a34 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:48 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a4a71903-9f93-4081-9389-1d3e496a4a34 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:48 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-a4a71903-9f93-4081-9389-1d3e496a4a34 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:32:48 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-a4a71903-9f93-4081-9389-1d3e496a4a34 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f" status: 200 len: 1377 microversion: 2.1 time: 0.149470 Apr 13 15:32:48 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 311/929] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:32:48 2023] GET /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f => generated 1377 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:32:48 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:32:48 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:32:48 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-37305bbd-4d5f-4896-8f13-611966705d1f tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:32:48 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-37305bbd-4d5f-4896-8f13-611966705d1f tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:32:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-37305bbd-4d5f-4896-8f13-611966705d1f tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-37305bbd-4d5f-4896-8f13-611966705d1f tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-37305bbd-4d5f-4896-8f13-611966705d1f tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-37305bbd-4d5f-4896-8f13-611966705d1f tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-37305bbd-4d5f-4896-8f13-611966705d1f tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:48 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-37305bbd-4d5f-4896-8f13-611966705d1f tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:48 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-37305bbd-4d5f-4896-8f13-611966705d1f tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:32:48 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-37305bbd-4d5f-4896-8f13-611966705d1f tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f" status: 200 len: 1377 microversion: 2.1 time: 0.163202 Apr 13 15:32:48 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 307/930] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:32:48 2023] GET /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f => generated 1377 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:32:49 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:32:49 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:32:49 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:32:49 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:32:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:49 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:49 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Going to try to terminate instance {{(pid=61873) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:32:49 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f" status: 204 len: 0 microversion: 2.1 time: 0.113172 Apr 13 15:32:49 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 313/931] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:32:49 2023] DELETE /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:32:49 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-b4a93211-91a3-4518-a638-ac0cbfe450bc tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:32:49 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-b4a93211-91a3-4518-a638-ac0cbfe450bc tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:32:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b4a93211-91a3-4518-a638-ac0cbfe450bc tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b4a93211-91a3-4518-a638-ac0cbfe450bc tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b4a93211-91a3-4518-a638-ac0cbfe450bc tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b4a93211-91a3-4518-a638-ac0cbfe450bc tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b4a93211-91a3-4518-a638-ac0cbfe450bc tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b4a93211-91a3-4518-a638-ac0cbfe450bc tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:49 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-b4a93211-91a3-4518-a638-ac0cbfe450bc tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:32:49 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-b4a93211-91a3-4518-a638-ac0cbfe450bc tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f" status: 200 len: 1383 microversion: 2.1 time: 0.157302 Apr 13 15:32:49 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 312/932] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:32:49 2023] GET /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f => generated 1383 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:32:49 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-3cc8fab2-1875-41ae-b329-153a4832f9c5 req-8cf96707-829e-4a87-aac3-65452b1ff9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8082f405-f0bd-4889-ba90-26350f262c4f", "name": "network-vif-unplugged", "status": "completed", "tag": "d32c2601-e479-49c2-a7bf-4d7bd00138af"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:32:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-3cc8fab2-1875-41ae-b329-153a4832f9c5 req-8cf96707-829e-4a87-aac3-65452b1ff9c4 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-3cc8fab2-1875-41ae-b329-153a4832f9c5 req-8cf96707-829e-4a87-aac3-65452b1ff9c4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:49 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-3cc8fab2-1875-41ae-b329-153a4832f9c5 req-8cf96707-829e-4a87-aac3-65452b1ff9c4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:49 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-3cc8fab2-1875-41ae-b329-153a4832f9c5 req-8cf96707-829e-4a87-aac3-65452b1ff9c4 service nova] Creating event network-vif-unplugged:d32c2601-e479-49c2-a7bf-4d7bd00138af for instance 8082f405-f0bd-4889-ba90-26350f262c4f on user Apr 13 15:32:49 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-3cc8fab2-1875-41ae-b329-153a4832f9c5 req-8cf96707-829e-4a87-aac3-65452b1ff9c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032205 Apr 13 15:32:49 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 308/933] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:32:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:32:50 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-dd580735-6d6f-4ee2-90e8-3749cbd1cf52 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:32:50 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-dd580735-6d6f-4ee2-90e8-3749cbd1cf52 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:32:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-dd580735-6d6f-4ee2-90e8-3749cbd1cf52 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-dd580735-6d6f-4ee2-90e8-3749cbd1cf52 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-dd580735-6d6f-4ee2-90e8-3749cbd1cf52 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-dd580735-6d6f-4ee2-90e8-3749cbd1cf52 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-dd580735-6d6f-4ee2-90e8-3749cbd1cf52 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-dd580735-6d6f-4ee2-90e8-3749cbd1cf52 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:50 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-dd580735-6d6f-4ee2-90e8-3749cbd1cf52 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:32:50 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-dd580735-6d6f-4ee2-90e8-3749cbd1cf52 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:32:50 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-dd580735-6d6f-4ee2-90e8-3749cbd1cf52 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:32:50 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-dd580735-6d6f-4ee2-90e8-3749cbd1cf52 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87" status: 200 len: 1784 microversion: 2.20 time: 0.434779 Apr 13 15:32:50 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 314/934] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:32:50 2023] GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87 => generated 1784 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:32:50 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-7a3961e7-667b-4bf6-971b-c94dda8f5711 req-a5b64d7c-c4fe-45fd-9825-996127873b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8082f405-f0bd-4889-ba90-26350f262c4f", "name": "network-vif-deleted", "tag": "d32c2601-e479-49c2-a7bf-4d7bd00138af"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:32:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-7a3961e7-667b-4bf6-971b-c94dda8f5711 req-a5b64d7c-c4fe-45fd-9825-996127873b3e service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-7a3961e7-667b-4bf6-971b-c94dda8f5711 req-a5b64d7c-c4fe-45fd-9825-996127873b3e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-7a3961e7-667b-4bf6-971b-c94dda8f5711 req-a5b64d7c-c4fe-45fd-9825-996127873b3e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:50 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-7a3961e7-667b-4bf6-971b-c94dda8f5711 req-a5b64d7c-c4fe-45fd-9825-996127873b3e service nova] Creating event network-vif-deleted:d32c2601-e479-49c2-a7bf-4d7bd00138af for instance 8082f405-f0bd-4889-ba90-26350f262c4f on user Apr 13 15:32:50 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-7a3961e7-667b-4bf6-971b-c94dda8f5711 req-a5b64d7c-c4fe-45fd-9825-996127873b3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032709 Apr 13 15:32:50 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 313/935] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:32:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:32:51 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-68fb1a89-3d2c-4558-a717-9406c285e2fd req-917b7550-3888-4252-b1bc-27291b7faf8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8082f405-f0bd-4889-ba90-26350f262c4f", "name": "network-vif-plugged", "status": "completed", "tag": "d32c2601-e479-49c2-a7bf-4d7bd00138af"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:32:51 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-68fb1a89-3d2c-4558-a717-9406c285e2fd req-917b7550-3888-4252-b1bc-27291b7faf8d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:32:51 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-68fb1a89-3d2c-4558-a717-9406c285e2fd req-917b7550-3888-4252-b1bc-27291b7faf8d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:32:51 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-68fb1a89-3d2c-4558-a717-9406c285e2fd req-917b7550-3888-4252-b1bc-27291b7faf8d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:32:51 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-68fb1a89-3d2c-4558-a717-9406c285e2fd req-917b7550-3888-4252-b1bc-27291b7faf8d service nova] Creating event network-vif-plugged:d32c2601-e479-49c2-a7bf-4d7bd00138af for instance 8082f405-f0bd-4889-ba90-26350f262c4f on user Apr 13 15:32:51 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-68fb1a89-3d2c-4558-a717-9406c285e2fd req-917b7550-3888-4252-b1bc-27291b7faf8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031916 Apr 13 15:32:51 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 309/936] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:32:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:33:01 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-b73ba59b-7ff2-47f2-a82d-2f0cad84ddfa tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1916020275", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "destination_type": "local"}, {"source_type": "volume", "uuid": "c7444a31-00a1-4db6-b80c-6ae2516d6b31", "destination_type": "invalid"}], "networks": [{"uuid": "8c2be808-8e48-40ed-8182-2243a199bf06"}]}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:33:01 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-b73ba59b-7ff2-47f2-a82d-2f0cad84ddfa tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Request method failure captured: Apr 13 15:33:01 user devstack@n-api.service[61873]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 13 15:33:01 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:33:01 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:33:01 user devstack@n-api.service[61873]: Connection: close Apr 13 15:33:01 user devstack@n-api.service[61873]: Content-Length: 494 Apr 13 15:33:01 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:33:01 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:33:01 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:33:01 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:33:01 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOB7kKQ44jHGyRwLCnKetXuptxn0znpv1SCvdmpcfSLebOWuTJbaDmT9s8_KTZV_Nzw6Nf9PmJBaiMYXvtuNBpo17X0Kcfru9DbFvcC33q8yjZQ1ouKJDxhQ0wQ0H-ndflDRipvny3s7y8abf-HRxzRrh7eJlHlgT1EnBB5Pboqyao0A Apr 13 15:33:01 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:33:01 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:33:01 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:33:01 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:33:01 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:33:01 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:33:01 user devstack@n-api.service[61873]: X-Project-Id: 1ac07b9454744832b26bf6bd126763ec Apr 13 15:33:01 user devstack@n-api.service[61873]: X-Project-Name: tempest-ServersNegativeTestJSON-187650290 Apr 13 15:33:01 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:33:01 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:33:01 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1ac07b9454744832b26bf6bd126763ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ac07b9454744832b26bf6bd126763ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ac07b9454744832b26bf6bd126763ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:33:01 user devstack@n-api.service[61873]: X-Tenant: tempest-ServersNegativeTestJSON-187650290 Apr 13 15:33:01 user devstack@n-api.service[61873]: X-Tenant-Id: 1ac07b9454744832b26bf6bd126763ec Apr 13 15:33:01 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187650290 Apr 13 15:33:01 user devstack@n-api.service[61873]: X-User: tempest-ServersNegativeTestJSON-187650290-project-member Apr 13 15:33:01 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:33:01 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:33:01 user devstack@n-api.service[61873]: X-User-Id: 3a6955546e4f4292a25acad709d27953 Apr 13 15:33:01 user devstack@n-api.service[61873]: X-User-Name: tempest-ServersNegativeTestJSON-187650290-project-member Apr 13 15:33:01 user devstack@n-api.service[61873]: Apr 13 15:33:01 user devstack@n-api.service[61873]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1916020275", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "destination_type": "local"}, {"source_type": "volume", "uuid": "c7444a31-00a1-4db6-b80c-6ae2516d6b31", "destination_type": "invalid"}], "networks": [{"uuid": "8c2be808-8e48-40ed-8182-2243a199bf06"}]}} Apr 13 15:33:01 user devstack@n-api.service[61873]: method: > Apr 13 15:33:01 user devstack@n-api.service[61873]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 15:33:01 user devstack@n-api.service[61873]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1916020275', 'imageRef': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'c7444a31-00a1-4db6-b80c-6ae2516d6b31', 'destination_type': 'invalid'}], 'networks': [{'uuid': '8c2be808-8e48-40ed-8182-2243a199bf06'}]}}} Apr 13 15:33:01 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise error Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi 'invalid' Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 15:33:01 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:33:01 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-b73ba59b-7ff2-47f2-a82d-2f0cad84ddfa tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:33:01 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-b73ba59b-7ff2-47f2-a82d-2f0cad84ddfa tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.010470 Apr 13 15:33:01 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 315/937] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:33:01 2023] POST /compute/v2.1/servers => generated 155 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:33:01 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=8 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:33:01 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=14 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:33:01 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-01f64661-5101-4dcb-975a-ef61b51b3f08 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:33:01 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-01f64661-5101-4dcb-975a-ef61b51b3f08 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:33:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-01f64661-5101-4dcb-975a-ef61b51b3f08 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-01f64661-5101-4dcb-975a-ef61b51b3f08 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-01f64661-5101-4dcb-975a-ef61b51b3f08 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-01f64661-5101-4dcb-975a-ef61b51b3f08 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-01f64661-5101-4dcb-975a-ef61b51b3f08 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-01f64661-5101-4dcb-975a-ef61b51b3f08 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:01 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-01f64661-5101-4dcb-975a-ef61b51b3f08 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6955546e4f4292a25acad709d27953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac07b9454744832b26bf6bd126763ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:33:01 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-01f64661-5101-4dcb-975a-ef61b51b3f08 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22bb22bd-efa8-4679-979a-dd0ce28a79e3" status: 200 len: 1493 microversion: 2.1 time: 0.228130 Apr 13 15:33:01 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 314/938] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:33:01 2023] GET /compute/v2.1/servers/22bb22bd-efa8-4679-979a-dd0ce28a79e3 => generated 1493 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:33:31 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:33:31 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=10 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:33:31 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-01f4f30c-1d0a-4d41-bb9e-f386bff016f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:33:31 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-01f4f30c-1d0a-4d41-bb9e-f386bff016f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:33:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-01f4f30c-1d0a-4d41-bb9e-f386bff016f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-01f4f30c-1d0a-4d41-bb9e-f386bff016f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-01f4f30c-1d0a-4d41-bb9e-f386bff016f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-01f4f30c-1d0a-4d41-bb9e-f386bff016f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-01f4f30c-1d0a-4d41-bb9e-f386bff016f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-01f4f30c-1d0a-4d41-bb9e-f386bff016f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:31 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-01f4f30c-1d0a-4d41-bb9e-f386bff016f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:33:31 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-01f4f30c-1d0a-4d41-bb9e-f386bff016f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643" status: 200 len: 1545 microversion: 2.1 time: 0.425589 Apr 13 15:33:31 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 310/939] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:33:31 2023] GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643 => generated 1545 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:33:31 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:33:31 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:33:31 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-940cf3a8-6abc-4daf-a82f-5f4e8e33c141 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:33:31 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-940cf3a8-6abc-4daf-a82f-5f4e8e33c141 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:33:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-940cf3a8-6abc-4daf-a82f-5f4e8e33c141 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-940cf3a8-6abc-4daf-a82f-5f4e8e33c141 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-940cf3a8-6abc-4daf-a82f-5f4e8e33c141 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-940cf3a8-6abc-4daf-a82f-5f4e8e33c141 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-940cf3a8-6abc-4daf-a82f-5f4e8e33c141 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:31 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-940cf3a8-6abc-4daf-a82f-5f4e8e33c141 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:31 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-940cf3a8-6abc-4daf-a82f-5f4e8e33c141 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643/action" status: 200 len: 28374 microversion: 2.1 time: 0.324069 Apr 13 15:33:31 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 316/940] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:33:31 2023] POST /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643/action => generated 28374 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:33:32 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-de022168-cc8b-4b02-b15c-342695e32640 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:33:32 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-de022168-cc8b-4b02-b15c-342695e32640 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:33:32 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:33:32 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:33:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-de022168-cc8b-4b02-b15c-342695e32640 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-de022168-cc8b-4b02-b15c-342695e32640 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-de022168-cc8b-4b02-b15c-342695e32640 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-de022168-cc8b-4b02-b15c-342695e32640 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-de022168-cc8b-4b02-b15c-342695e32640 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-de022168-cc8b-4b02-b15c-342695e32640 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:32 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-de022168-cc8b-4b02-b15c-342695e32640 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:33:32 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-de022168-cc8b-4b02-b15c-342695e32640 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58e8e652-d56c-45b6-92ff-a50406ea48e9" status: 200 len: 1538 microversion: 2.1 time: 0.211314 Apr 13 15:33:32 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 315/941] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:33:32 2023] GET /compute/v2.1/servers/58e8e652-d56c-45b6-92ff-a50406ea48e9 => generated 1538 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:33:39 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-7032f4c9-3217-40bd-926f-689872c3b0ba tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:33:39 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-7032f4c9-3217-40bd-926f-689872c3b0ba tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:33:39 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7032f4c9-3217-40bd-926f-689872c3b0ba tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:39 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7032f4c9-3217-40bd-926f-689872c3b0ba tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:39 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7032f4c9-3217-40bd-926f-689872c3b0ba tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:39 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7032f4c9-3217-40bd-926f-689872c3b0ba tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:39 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7032f4c9-3217-40bd-926f-689872c3b0ba tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:39 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7032f4c9-3217-40bd-926f-689872c3b0ba tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:39 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-7032f4c9-3217-40bd-926f-689872c3b0ba tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HTTP exception thrown: Instance 8082f405-f0bd-4889-ba90-26350f262c4f could not be found. Apr 13 15:33:39 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-7032f4c9-3217-40bd-926f-689872c3b0ba tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Request method failure captured: Apr 13 15:33:39 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f HTTP/1.1 Apr 13 15:33:39 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:33:39 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:33:39 user devstack@n-api.service[61871]: Connection: close Apr 13 15:33:39 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:33:39 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:33:39 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:33:39 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:33:39 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:33:39 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOCAkop2IkGDfTg_hLFhCzVF0r-Snnfp8mpD-rNTz3fSyNRaGCKUvuIX-bvQSQt24XSPbyAQXj1tiZH1C9TwK7awcWO7BHnx8xBG9YOZB63Dpng-DDIXtPRCA4OT9QRrpOESCL1mwTOYQNnj8ZeocbvX0wE2u-g1UjUjvIIUGz4v71K0 Apr 13 15:33:39 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:33:39 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:33:39 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:33:39 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:33:39 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:33:39 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:33:39 user devstack@n-api.service[61871]: X-Project-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:33:39 user devstack@n-api.service[61871]: X-Project-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:33:39 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:33:39 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:33:39 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:33:39 user devstack@n-api.service[61871]: X-Tenant: tempest-TestVolumeBootPattern-374778702 Apr 13 15:33:39 user devstack@n-api.service[61871]: X-Tenant-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:33:39 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:33:39 user devstack@n-api.service[61871]: X-User: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:33:39 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:33:39 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:33:39 user devstack@n-api.service[61871]: X-User-Id: 0307fb8d127a41079e34355904352231 Apr 13 15:33:39 user devstack@n-api.service[61871]: X-User-Name: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:33:39 user devstack@n-api.service[61871]: method: > Apr 13 15:33:39 user devstack@n-api.service[61871]: exception: Instance 8082f405-f0bd-4889-ba90-26350f262c4f could not be found. Apr 13 15:33:39 user devstack@n-api.service[61871]: action_args: {'id': '8082f405-f0bd-4889-ba90-26350f262c4f'} Apr 13 15:33:39 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8082f405-f0bd-4889-ba90-26350f262c4f could not be found. Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8082f405-f0bd-4889-ba90-26350f262c4f could not be found. Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8082f405-f0bd-4889-ba90-26350f262c4f could not be found. Apr 13 15:33:39 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:33:39 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-7032f4c9-3217-40bd-926f-689872c3b0ba tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Returning 404 to user: Instance 8082f405-f0bd-4889-ba90-26350f262c4f could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:33:39 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-7032f4c9-3217-40bd-926f-689872c3b0ba tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f" status: 404 len: 111 microversion: 2.1 time: 0.028678 Apr 13 15:33:39 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 311/942] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:33:39 2023] GET /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:33:39 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-922ff712-bd67-46f8-aa31-bc8491db3a3c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:33:39 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-922ff712-bd67-46f8-aa31-bc8491db3a3c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:33:39 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-922ff712-bd67-46f8-aa31-bc8491db3a3c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:39 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-922ff712-bd67-46f8-aa31-bc8491db3a3c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:39 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-922ff712-bd67-46f8-aa31-bc8491db3a3c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:39 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-922ff712-bd67-46f8-aa31-bc8491db3a3c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:39 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-922ff712-bd67-46f8-aa31-bc8491db3a3c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:39 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-922ff712-bd67-46f8-aa31-bc8491db3a3c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:39 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-922ff712-bd67-46f8-aa31-bc8491db3a3c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HTTP exception thrown: Instance 8082f405-f0bd-4889-ba90-26350f262c4f could not be found. Apr 13 15:33:39 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-922ff712-bd67-46f8-aa31-bc8491db3a3c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Request method failure captured: Apr 13 15:33:39 user devstack@n-api.service[61873]: request: DELETE /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f HTTP/1.1 Apr 13 15:33:39 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:33:39 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:33:39 user devstack@n-api.service[61873]: Connection: close Apr 13 15:33:39 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:33:39 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:33:39 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:33:39 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:33:39 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:33:39 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOCAkop2IkGDfTg_hLFhCzVF0r-Snnfp8mpD-rNTz3fSyNRaGCKUvuIX-bvQSQt24XSPbyAQXj1tiZH1C9TwK7awcWO7BHnx8xBG9YOZB63Dpng-DDIXtPRCA4OT9QRrpOESCL1mwTOYQNnj8ZeocbvX0wE2u-g1UjUjvIIUGz4v71K0 Apr 13 15:33:39 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:33:39 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:33:39 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:33:39 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:33:39 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:33:39 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:33:39 user devstack@n-api.service[61873]: X-Project-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:33:39 user devstack@n-api.service[61873]: X-Project-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:33:39 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:33:39 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:33:39 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:33:39 user devstack@n-api.service[61873]: X-Tenant: tempest-TestVolumeBootPattern-374778702 Apr 13 15:33:39 user devstack@n-api.service[61873]: X-Tenant-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:33:39 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:33:39 user devstack@n-api.service[61873]: X-User: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:33:39 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:33:39 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:33:39 user devstack@n-api.service[61873]: X-User-Id: 0307fb8d127a41079e34355904352231 Apr 13 15:33:39 user devstack@n-api.service[61873]: X-User-Name: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:33:39 user devstack@n-api.service[61873]: method: > Apr 13 15:33:39 user devstack@n-api.service[61873]: exception: Instance 8082f405-f0bd-4889-ba90-26350f262c4f could not be found. Apr 13 15:33:39 user devstack@n-api.service[61873]: action_args: {'id': '8082f405-f0bd-4889-ba90-26350f262c4f'} Apr 13 15:33:39 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8082f405-f0bd-4889-ba90-26350f262c4f could not be found. Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8082f405-f0bd-4889-ba90-26350f262c4f could not be found. Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8082f405-f0bd-4889-ba90-26350f262c4f could not be found. Apr 13 15:33:39 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:33:39 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-922ff712-bd67-46f8-aa31-bc8491db3a3c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Returning 404 to user: Instance 8082f405-f0bd-4889-ba90-26350f262c4f could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:33:39 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-922ff712-bd67-46f8-aa31-bc8491db3a3c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f" status: 404 len: 111 microversion: 2.1 time: 0.036095 Apr 13 15:33:39 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 317/943] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:33:39 2023] DELETE /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:33:39 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-441bdf00-8bbd-410a-818d-371830d6345e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:33:39 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-441bdf00-8bbd-410a-818d-371830d6345e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:33:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-441bdf00-8bbd-410a-818d-371830d6345e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-441bdf00-8bbd-410a-818d-371830d6345e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-441bdf00-8bbd-410a-818d-371830d6345e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-441bdf00-8bbd-410a-818d-371830d6345e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-441bdf00-8bbd-410a-818d-371830d6345e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-441bdf00-8bbd-410a-818d-371830d6345e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:39 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-441bdf00-8bbd-410a-818d-371830d6345e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HTTP exception thrown: Instance 8082f405-f0bd-4889-ba90-26350f262c4f could not be found. Apr 13 15:33:39 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-441bdf00-8bbd-410a-818d-371830d6345e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Request method failure captured: Apr 13 15:33:39 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f HTTP/1.1 Apr 13 15:33:39 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:33:39 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:33:39 user devstack@n-api.service[61872]: Connection: close Apr 13 15:33:39 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:33:39 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:33:39 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:33:39 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:33:39 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:33:39 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOCAkop2IkGDfTg_hLFhCzVF0r-Snnfp8mpD-rNTz3fSyNRaGCKUvuIX-bvQSQt24XSPbyAQXj1tiZH1C9TwK7awcWO7BHnx8xBG9YOZB63Dpng-DDIXtPRCA4OT9QRrpOESCL1mwTOYQNnj8ZeocbvX0wE2u-g1UjUjvIIUGz4v71K0 Apr 13 15:33:39 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:33:39 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:33:39 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:33:39 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:33:39 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:33:39 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:33:39 user devstack@n-api.service[61872]: X-Project-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:33:39 user devstack@n-api.service[61872]: X-Project-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:33:39 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:33:39 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:33:39 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:33:39 user devstack@n-api.service[61872]: X-Tenant: tempest-TestVolumeBootPattern-374778702 Apr 13 15:33:39 user devstack@n-api.service[61872]: X-Tenant-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:33:39 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:33:39 user devstack@n-api.service[61872]: X-User: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:33:39 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:33:39 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:33:39 user devstack@n-api.service[61872]: X-User-Id: 0307fb8d127a41079e34355904352231 Apr 13 15:33:39 user devstack@n-api.service[61872]: X-User-Name: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:33:39 user devstack@n-api.service[61872]: method: > Apr 13 15:33:39 user devstack@n-api.service[61872]: exception: Instance 8082f405-f0bd-4889-ba90-26350f262c4f could not be found. Apr 13 15:33:39 user devstack@n-api.service[61872]: action_args: {'id': '8082f405-f0bd-4889-ba90-26350f262c4f'} Apr 13 15:33:39 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8082f405-f0bd-4889-ba90-26350f262c4f could not be found. Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8082f405-f0bd-4889-ba90-26350f262c4f could not be found. Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8082f405-f0bd-4889-ba90-26350f262c4f could not be found. Apr 13 15:33:39 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:33:39 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-441bdf00-8bbd-410a-818d-371830d6345e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Returning 404 to user: Instance 8082f405-f0bd-4889-ba90-26350f262c4f could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:33:39 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-441bdf00-8bbd-410a-818d-371830d6345e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f" status: 404 len: 111 microversion: 2.1 time: 0.029278 Apr 13 15:33:39 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 316/944] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:33:39 2023] GET /compute/v2.1/servers/8082f405-f0bd-4889-ba90-26350f262c4f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:33:46 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-2134972973", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "662f5cd6-04ae-41af-8266-365985d19beb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3"}]}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:33:46 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] validate_networks() for [('66ea8c1a-1c77-4a2a-ab35-64acac4762c3', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:33:47 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:33:47 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:33:47 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:33:47 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:33:47 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:33:47 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:47 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:47 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:47 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:47 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:47 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:47 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting quotas for project d5d7f771264c4cd2bc595a2c525082d0. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:33:47 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting quotas for user 0307fb8d127a41079e34355904352231 and project d5d7f771264c4cd2bc595a2c525082d0. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:33:47 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:33:47 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='662f5cd6-04ae-41af-8266-365985d19beb',volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:33:47 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.681966 Apr 13 15:33:47 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 312/945] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:33:46 2023] POST /compute/v2.1/servers => generated 378 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:33:47 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-4907deca-5365-43bb-ad72-4d2e2fb881fb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:33:47 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-4907deca-5365-43bb-ad72-4d2e2fb881fb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:33:47 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-4907deca-5365-43bb-ad72-4d2e2fb881fb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:33:47 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-4907deca-5365-43bb-ad72-4d2e2fb881fb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227" status: 200 len: 1066 microversion: 2.1 time: 0.092016 Apr 13 15:33:47 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 318/946] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:33:47 2023] GET /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227 => generated 1066 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:33:49 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=4 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:33:49 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=8 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:33:49 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-3a00f2ac-dd14-408b-bdfc-a0603f692714 req-0a1497d9-c221-43a5-832b-1051183ca6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "362ab343-a3a0-46e0-a0a7-c25e60133227", "tag": "b70334b8-70db-4e5e-b2c9-11b514210eef"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:33:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3a00f2ac-dd14-408b-bdfc-a0603f692714 req-0a1497d9-c221-43a5-832b-1051183ca6a5 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3a00f2ac-dd14-408b-bdfc-a0603f692714 req-0a1497d9-c221-43a5-832b-1051183ca6a5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3a00f2ac-dd14-408b-bdfc-a0603f692714 req-0a1497d9-c221-43a5-832b-1051183ca6a5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:49 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-3a00f2ac-dd14-408b-bdfc-a0603f692714 req-0a1497d9-c221-43a5-832b-1051183ca6a5 service nova] Creating event network-changed:b70334b8-70db-4e5e-b2c9-11b514210eef for instance 362ab343-a3a0-46e0-a0a7-c25e60133227 on user Apr 13 15:33:49 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-3a00f2ac-dd14-408b-bdfc-a0603f692714 req-0a1497d9-c221-43a5-832b-1051183ca6a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111343 Apr 13 15:33:49 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 317/947] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:33:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:33:51 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-e7cb5949-e815-4cfe-8822-301066768f49 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:33:51 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-e7cb5949-e815-4cfe-8822-301066768f49 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:33:51 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e7cb5949-e815-4cfe-8822-301066768f49 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:51 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e7cb5949-e815-4cfe-8822-301066768f49 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:51 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e7cb5949-e815-4cfe-8822-301066768f49 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:51 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e7cb5949-e815-4cfe-8822-301066768f49 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:51 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e7cb5949-e815-4cfe-8822-301066768f49 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:51 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-e7cb5949-e815-4cfe-8822-301066768f49 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:51 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-e7cb5949-e815-4cfe-8822-301066768f49 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87/os-volume_attachments/37b94d35-9939-4ebd-989f-49669dd5ce82" status: 200 len: 194 microversion: 2.20 time: 0.140188 Apr 13 15:33:51 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 313/948] 10.0.0.210 () {64 vars in 1531 bytes} [Thu Apr 13 15:33:50 2023] GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87/os-volume_attachments/37b94d35-9939-4ebd-989f-49669dd5ce82 => generated 194 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:33:51 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:33:51 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:33:51 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:33:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:51 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:51 user devstack@n-api.service[61873]: DEBUG nova.objects.instance [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'services' on Instance uuid 9761101e-4bce-4e7b-8137-569bf8d27f87 {{(pid=61873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:33:51 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87/os-volume_attachments/37b94d35-9939-4ebd-989f-49669dd5ce82" status: 202 len: 0 microversion: 2.20 time: 0.186745 Apr 13 15:33:51 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 319/949] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 15:33:51 2023] DELETE /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87/os-volume_attachments/37b94d35-9939-4ebd-989f-49669dd5ce82 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:33:51 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-7d888637-f098-46b1-9c80-7bd105f32933 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:33:51 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-7d888637-f098-46b1-9c80-7bd105f32933 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:33:51 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7d888637-f098-46b1-9c80-7bd105f32933 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:51 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7d888637-f098-46b1-9c80-7bd105f32933 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:51 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7d888637-f098-46b1-9c80-7bd105f32933 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:51 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7d888637-f098-46b1-9c80-7bd105f32933 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:51 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7d888637-f098-46b1-9c80-7bd105f32933 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:51 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-7d888637-f098-46b1-9c80-7bd105f32933 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:51 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-7d888637-f098-46b1-9c80-7bd105f32933 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051162 Apr 13 15:33:51 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 318/950] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 15:33:51 2023] GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 13 15:33:55 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-10cd02f6-09bb-48ca-8630-818435aff703 req-f7fc645f-08e7-46d4-8263-3124c1ade256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362ab343-a3a0-46e0-a0a7-c25e60133227", "name": "network-vif-plugged", "status": "completed", "tag": "b70334b8-70db-4e5e-b2c9-11b514210eef"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:33:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-10cd02f6-09bb-48ca-8630-818435aff703 req-f7fc645f-08e7-46d4-8263-3124c1ade256 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-10cd02f6-09bb-48ca-8630-818435aff703 req-f7fc645f-08e7-46d4-8263-3124c1ade256 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:55 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-10cd02f6-09bb-48ca-8630-818435aff703 req-f7fc645f-08e7-46d4-8263-3124c1ade256 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:55 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-10cd02f6-09bb-48ca-8630-818435aff703 req-f7fc645f-08e7-46d4-8263-3124c1ade256 service nova] Creating event network-vif-plugged:b70334b8-70db-4e5e-b2c9-11b514210eef for instance 362ab343-a3a0-46e0-a0a7-c25e60133227 on user Apr 13 15:33:55 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-10cd02f6-09bb-48ca-8630-818435aff703 req-f7fc645f-08e7-46d4-8263-3124c1ade256 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057553 Apr 13 15:33:55 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 314/951] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:33:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:33:57 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:33:57 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-d18497a0-fec8-4daa-aa49-592a500b919e req-7e4e28ac-b2c2-4e4b-aa04-9e7883c08859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362ab343-a3a0-46e0-a0a7-c25e60133227", "name": "network-vif-plugged", "status": "completed", "tag": "b70334b8-70db-4e5e-b2c9-11b514210eef"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:33:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d18497a0-fec8-4daa-aa49-592a500b919e req-7e4e28ac-b2c2-4e4b-aa04-9e7883c08859 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:33:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d18497a0-fec8-4daa-aa49-592a500b919e req-7e4e28ac-b2c2-4e4b-aa04-9e7883c08859 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:33:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-d18497a0-fec8-4daa-aa49-592a500b919e req-7e4e28ac-b2c2-4e4b-aa04-9e7883c08859 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:33:57 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-d18497a0-fec8-4daa-aa49-592a500b919e req-7e4e28ac-b2c2-4e4b-aa04-9e7883c08859 service nova] Creating event network-vif-plugged:b70334b8-70db-4e5e-b2c9-11b514210eef for instance 362ab343-a3a0-46e0-a0a7-c25e60133227 on user Apr 13 15:33:57 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-d18497a0-fec8-4daa-aa49-592a500b919e req-7e4e28ac-b2c2-4e4b-aa04-9e7883c08859 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035592 Apr 13 15:33:57 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 320/952] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:33:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-87a37463-59dc-4ea8-8552-e6702c56e949 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-87a37463-59dc-4ea8-8552-e6702c56e949 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=4 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=8 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-87a37463-59dc-4ea8-8552-e6702c56e949 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-87a37463-59dc-4ea8-8552-e6702c56e949 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-87a37463-59dc-4ea8-8552-e6702c56e949 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-87a37463-59dc-4ea8-8552-e6702c56e949 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-87a37463-59dc-4ea8-8552-e6702c56e949 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-87a37463-59dc-4ea8-8552-e6702c56e949 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:06 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-87a37463-59dc-4ea8-8552-e6702c56e949 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] HTTP exception thrown: Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b could not be found. Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-87a37463-59dc-4ea8-8552-e6702c56e949 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Request method failure captured: Apr 13 15:34:06 user devstack@n-api.service[61872]: request: DELETE /compute/v2.1/servers/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b HTTP/1.1 Apr 13 15:34:06 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:34:06 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:34:06 user devstack@n-api.service[61872]: Connection: close Apr 13 15:34:06 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:34:06 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:34:06 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:34:06 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:34:06 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:34:06 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOB7kKQ44jHGyRwLCnKetXuptxn0znpv1SCvdmpcfSLebOWuTJbaDmT9s8_KTZV_Nzw6Nf9PmJBaiMYXvtuNBpo17X0Kcfru9DbFvcC33q8yjZQ1ouKJDxhQ0wQ0H-ndflDRipvny3s7y8abf-HRxzRrh7eJlHlgT1EnBB5Pboqyao0A Apr 13 15:34:06 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:34:06 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:34:06 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:34:06 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:34:06 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:34:06 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:34:06 user devstack@n-api.service[61872]: X-Project-Id: 1ac07b9454744832b26bf6bd126763ec Apr 13 15:34:06 user devstack@n-api.service[61872]: X-Project-Name: tempest-ServersNegativeTestJSON-187650290 Apr 13 15:34:06 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:34:06 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:34:06 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1ac07b9454744832b26bf6bd126763ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ac07b9454744832b26bf6bd126763ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ac07b9454744832b26bf6bd126763ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:34:06 user devstack@n-api.service[61872]: X-Tenant: tempest-ServersNegativeTestJSON-187650290 Apr 13 15:34:06 user devstack@n-api.service[61872]: X-Tenant-Id: 1ac07b9454744832b26bf6bd126763ec Apr 13 15:34:06 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187650290 Apr 13 15:34:06 user devstack@n-api.service[61872]: X-User: tempest-ServersNegativeTestJSON-187650290-project-member Apr 13 15:34:06 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:34:06 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:34:06 user devstack@n-api.service[61872]: X-User-Id: 3a6955546e4f4292a25acad709d27953 Apr 13 15:34:06 user devstack@n-api.service[61872]: X-User-Name: tempest-ServersNegativeTestJSON-187650290-project-member Apr 13 15:34:06 user devstack@n-api.service[61872]: method: > Apr 13 15:34:06 user devstack@n-api.service[61872]: exception: Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b could not be found. Apr 13 15:34:06 user devstack@n-api.service[61872]: action_args: {'id': '8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b'} Apr 13 15:34:06 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b could not be found. Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b could not be found. Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b could not be found. Apr 13 15:34:06 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-87a37463-59dc-4ea8-8552-e6702c56e949 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Returning 404 to user: Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:34:06 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-87a37463-59dc-4ea8-8552-e6702c56e949 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b" status: 404 len: 111 microversion: 2.1 time: 0.039870 Apr 13 15:34:06 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 319/953] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:34:06 2023] DELETE /compute/v2.1/servers/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:34:06 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:34:06 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:34:06 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:34:06 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=18 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:34:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-87366c91-5325-4504-9f2d-91359a42a9c8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:34:06 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-87366c91-5325-4504-9f2d-91359a42a9c8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:34:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-87366c91-5325-4504-9f2d-91359a42a9c8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-87366c91-5325-4504-9f2d-91359a42a9c8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-87366c91-5325-4504-9f2d-91359a42a9c8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-87366c91-5325-4504-9f2d-91359a42a9c8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-87366c91-5325-4504-9f2d-91359a42a9c8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-87366c91-5325-4504-9f2d-91359a42a9c8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:06 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-87366c91-5325-4504-9f2d-91359a42a9c8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] HTTP exception thrown: Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b could not be found. Apr 13 15:34:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-87366c91-5325-4504-9f2d-91359a42a9c8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Request method failure captured: Apr 13 15:34:06 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b HTTP/1.1 Apr 13 15:34:06 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:34:06 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:34:06 user devstack@n-api.service[61871]: Connection: close Apr 13 15:34:06 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:34:06 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:34:06 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:34:06 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:34:06 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:34:06 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOB7kKQ44jHGyRwLCnKetXuptxn0znpv1SCvdmpcfSLebOWuTJbaDmT9s8_KTZV_Nzw6Nf9PmJBaiMYXvtuNBpo17X0Kcfru9DbFvcC33q8yjZQ1ouKJDxhQ0wQ0H-ndflDRipvny3s7y8abf-HRxzRrh7eJlHlgT1EnBB5Pboqyao0A Apr 13 15:34:06 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:34:06 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:34:06 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:34:06 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:34:06 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:34:06 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:34:06 user devstack@n-api.service[61871]: X-Project-Id: 1ac07b9454744832b26bf6bd126763ec Apr 13 15:34:06 user devstack@n-api.service[61871]: X-Project-Name: tempest-ServersNegativeTestJSON-187650290 Apr 13 15:34:06 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:34:06 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:34:06 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1ac07b9454744832b26bf6bd126763ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ac07b9454744832b26bf6bd126763ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ac07b9454744832b26bf6bd126763ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:34:06 user devstack@n-api.service[61871]: X-Tenant: tempest-ServersNegativeTestJSON-187650290 Apr 13 15:34:06 user devstack@n-api.service[61871]: X-Tenant-Id: 1ac07b9454744832b26bf6bd126763ec Apr 13 15:34:06 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187650290 Apr 13 15:34:06 user devstack@n-api.service[61871]: X-User: tempest-ServersNegativeTestJSON-187650290-project-member Apr 13 15:34:06 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:34:06 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:34:06 user devstack@n-api.service[61871]: X-User-Id: 3a6955546e4f4292a25acad709d27953 Apr 13 15:34:06 user devstack@n-api.service[61871]: X-User-Name: tempest-ServersNegativeTestJSON-187650290-project-member Apr 13 15:34:06 user devstack@n-api.service[61871]: method: > Apr 13 15:34:06 user devstack@n-api.service[61871]: exception: Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b could not be found. Apr 13 15:34:06 user devstack@n-api.service[61871]: action_args: {'id': '8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b'} Apr 13 15:34:06 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b could not be found. Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b could not be found. Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b could not be found. Apr 13 15:34:06 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:34:06 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-87366c91-5325-4504-9f2d-91359a42a9c8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Returning 404 to user: Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:34:06 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-87366c91-5325-4504-9f2d-91359a42a9c8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b" status: 404 len: 111 microversion: 2.1 time: 0.035161 Apr 13 15:34:06 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 315/954] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:34:06 2023] GET /compute/v2.1/servers/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:34:06 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:34:06 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:34:06 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=13 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:34:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:06 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:06 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Going to try to terminate instance {{(pid=61873) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:34:06 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/22bb22bd-efa8-4679-979a-dd0ce28a79e3" status: 204 len: 0 microversion: 2.1 time: 0.146134 Apr 13 15:34:06 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 321/955] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:34:06 2023] DELETE /compute/v2.1/servers/22bb22bd-efa8-4679-979a-dd0ce28a79e3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-31980214-8dfd-479c-ac6c-43f710b5fc12 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-31980214-8dfd-479c-ac6c-43f710b5fc12 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-31980214-8dfd-479c-ac6c-43f710b5fc12 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-31980214-8dfd-479c-ac6c-43f710b5fc12 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-31980214-8dfd-479c-ac6c-43f710b5fc12 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-31980214-8dfd-479c-ac6c-43f710b5fc12 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-31980214-8dfd-479c-ac6c-43f710b5fc12 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-31980214-8dfd-479c-ac6c-43f710b5fc12 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:06 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-31980214-8dfd-479c-ac6c-43f710b5fc12 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a6955546e4f4292a25acad709d27953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac07b9454744832b26bf6bd126763ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:34:06 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-31980214-8dfd-479c-ac6c-43f710b5fc12 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22bb22bd-efa8-4679-979a-dd0ce28a79e3" status: 200 len: 1499 microversion: 2.1 time: 0.214028 Apr 13 15:34:06 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 320/956] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:34:06 2023] GET /compute/v2.1/servers/22bb22bd-efa8-4679-979a-dd0ce28a79e3 => generated 1499 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:34:07 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-3f29e79c-dff6-4b34-a263-c9b461e0511b req-85d47b50-7f72-43a0-ae6b-dfe13566a0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22bb22bd-efa8-4679-979a-dd0ce28a79e3", "name": "network-vif-unplugged", "status": "completed", "tag": "51fbfc5f-6a68-41b6-9153-192b47c76902"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:34:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-3f29e79c-dff6-4b34-a263-c9b461e0511b req-85d47b50-7f72-43a0-ae6b-dfe13566a0d5 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-3f29e79c-dff6-4b34-a263-c9b461e0511b req-85d47b50-7f72-43a0-ae6b-dfe13566a0d5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-3f29e79c-dff6-4b34-a263-c9b461e0511b req-85d47b50-7f72-43a0-ae6b-dfe13566a0d5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:07 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-3f29e79c-dff6-4b34-a263-c9b461e0511b req-85d47b50-7f72-43a0-ae6b-dfe13566a0d5 service nova] Creating event network-vif-unplugged:51fbfc5f-6a68-41b6-9153-192b47c76902 for instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 on user Apr 13 15:34:07 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-3f29e79c-dff6-4b34-a263-c9b461e0511b req-85d47b50-7f72-43a0-ae6b-dfe13566a0d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122134 Apr 13 15:34:07 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 316/957] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:34:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:34:07 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-e6e5c56c-d357-4631-b1ec-8ed8247ce30a req-bb56e5e0-10cd-4cfb-bb9b-01a4d476b8df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22bb22bd-efa8-4679-979a-dd0ce28a79e3", "name": "network-vif-deleted", "tag": "51fbfc5f-6a68-41b6-9153-192b47c76902"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:34:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-e6e5c56c-d357-4631-b1ec-8ed8247ce30a req-bb56e5e0-10cd-4cfb-bb9b-01a4d476b8df service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-e6e5c56c-d357-4631-b1ec-8ed8247ce30a req-bb56e5e0-10cd-4cfb-bb9b-01a4d476b8df service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:07 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-e6e5c56c-d357-4631-b1ec-8ed8247ce30a req-bb56e5e0-10cd-4cfb-bb9b-01a4d476b8df service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:07 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-e6e5c56c-d357-4631-b1ec-8ed8247ce30a req-bb56e5e0-10cd-4cfb-bb9b-01a4d476b8df service nova] Creating event network-vif-deleted:51fbfc5f-6a68-41b6-9153-192b47c76902 for instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 on user Apr 13 15:34:07 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-e6e5c56c-d357-4631-b1ec-8ed8247ce30a req-bb56e5e0-10cd-4cfb-bb9b-01a4d476b8df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034617 Apr 13 15:34:07 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 322/958] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:34:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:34:09 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-9856b982-3b49-4822-b084-ee09484e18e4 req-446f0827-2d9c-4790-b66a-b15a6bf0480e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22bb22bd-efa8-4679-979a-dd0ce28a79e3", "name": "network-vif-plugged", "status": "completed", "tag": "51fbfc5f-6a68-41b6-9153-192b47c76902"}, {"server_uuid": "22bb22bd-efa8-4679-979a-dd0ce28a79e3", "name": "network-vif-plugged", "status": "completed", "tag": "51fbfc5f-6a68-41b6-9153-192b47c76902"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:34:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-9856b982-3b49-4822-b084-ee09484e18e4 req-446f0827-2d9c-4790-b66a-b15a6bf0480e service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-9856b982-3b49-4822-b084-ee09484e18e4 req-446f0827-2d9c-4790-b66a-b15a6bf0480e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-9856b982-3b49-4822-b084-ee09484e18e4 req-446f0827-2d9c-4790-b66a-b15a6bf0480e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:09 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-9856b982-3b49-4822-b084-ee09484e18e4 req-446f0827-2d9c-4790-b66a-b15a6bf0480e service nova] Creating event network-vif-plugged:51fbfc5f-6a68-41b6-9153-192b47c76902 for instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 on user Apr 13 15:34:09 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-9856b982-3b49-4822-b084-ee09484e18e4 req-446f0827-2d9c-4790-b66a-b15a6bf0480e service nova] Creating event network-vif-plugged:51fbfc5f-6a68-41b6-9153-192b47c76902 for instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 on user Apr 13 15:34:09 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-9856b982-3b49-4822-b084-ee09484e18e4 req-446f0827-2d9c-4790-b66a-b15a6bf0480e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034714 Apr 13 15:34:09 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 321/959] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:34:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:34:32 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:34:32 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:34:32 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=4 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:34:32 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=4 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:34:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:32 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Going to try to terminate instance {{(pid=61871) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:34:32 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643" status: 204 len: 0 microversion: 2.1 time: 0.124233 Apr 13 15:34:32 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 317/960] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:34:32 2023] DELETE /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:34:32 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:34:32 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:34:32 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7f8f3c93-93e0-479e-8e36-34130ec7c399 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:34:32 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-7f8f3c93-93e0-479e-8e36-34130ec7c399 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:34:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7f8f3c93-93e0-479e-8e36-34130ec7c399 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7f8f3c93-93e0-479e-8e36-34130ec7c399 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7f8f3c93-93e0-479e-8e36-34130ec7c399 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7f8f3c93-93e0-479e-8e36-34130ec7c399 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7f8f3c93-93e0-479e-8e36-34130ec7c399 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7f8f3c93-93e0-479e-8e36-34130ec7c399 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:32 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-7f8f3c93-93e0-479e-8e36-34130ec7c399 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:34:32 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7f8f3c93-93e0-479e-8e36-34130ec7c399 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643" status: 200 len: 1551 microversion: 2.1 time: 0.165809 Apr 13 15:34:32 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 323/961] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:34:32 2023] GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643 => generated 1551 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:34:32 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:34:32 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=10 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:34:32 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-5678719e-0613-4907-8239-3eee7490972c req-34793f1e-edb5-4d7a-8147-bee31a5790c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4211d816-b8aa-452e-9587-bf131e42d643", "name": "network-vif-unplugged", "status": "completed", "tag": "e42a12d0-d042-4277-83a6-7141c1df1ea2"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:34:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-5678719e-0613-4907-8239-3eee7490972c req-34793f1e-edb5-4d7a-8147-bee31a5790c8 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-5678719e-0613-4907-8239-3eee7490972c req-34793f1e-edb5-4d7a-8147-bee31a5790c8 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:32 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-5678719e-0613-4907-8239-3eee7490972c req-34793f1e-edb5-4d7a-8147-bee31a5790c8 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:32 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-5678719e-0613-4907-8239-3eee7490972c req-34793f1e-edb5-4d7a-8147-bee31a5790c8 service nova] Creating event network-vif-unplugged:e42a12d0-d042-4277-83a6-7141c1df1ea2 for instance 4211d816-b8aa-452e-9587-bf131e42d643 on user Apr 13 15:34:32 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-5678719e-0613-4907-8239-3eee7490972c req-34793f1e-edb5-4d7a-8147-bee31a5790c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097433 Apr 13 15:34:32 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 322/962] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:34:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:34:34 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-58d0e896-2819-4e84-b61a-25aa0af76c4f req-1d652cad-37b0-4eea-974e-e0797532f1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4211d816-b8aa-452e-9587-bf131e42d643", "name": "network-vif-deleted", "tag": "e42a12d0-d042-4277-83a6-7141c1df1ea2"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:34:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-58d0e896-2819-4e84-b61a-25aa0af76c4f req-1d652cad-37b0-4eea-974e-e0797532f1b3 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-58d0e896-2819-4e84-b61a-25aa0af76c4f req-1d652cad-37b0-4eea-974e-e0797532f1b3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-58d0e896-2819-4e84-b61a-25aa0af76c4f req-1d652cad-37b0-4eea-974e-e0797532f1b3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:34 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-58d0e896-2819-4e84-b61a-25aa0af76c4f req-1d652cad-37b0-4eea-974e-e0797532f1b3 service nova] Creating event network-vif-deleted:e42a12d0-d042-4277-83a6-7141c1df1ea2 for instance 4211d816-b8aa-452e-9587-bf131e42d643 on user Apr 13 15:34:34 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-58d0e896-2819-4e84-b61a-25aa0af76c4f req-1d652cad-37b0-4eea-974e-e0797532f1b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028627 Apr 13 15:34:34 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 318/963] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:34:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:34:34 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-bf52eab8-d036-45c9-beea-3de4c062ea20 req-dd919d84-615c-43ce-8b5b-1936e9bcb54f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4211d816-b8aa-452e-9587-bf131e42d643", "name": "network-vif-plugged", "status": "completed", "tag": "e42a12d0-d042-4277-83a6-7141c1df1ea2"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:34:34 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-bf52eab8-d036-45c9-beea-3de4c062ea20 req-dd919d84-615c-43ce-8b5b-1936e9bcb54f service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:34 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-bf52eab8-d036-45c9-beea-3de4c062ea20 req-dd919d84-615c-43ce-8b5b-1936e9bcb54f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:34 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-bf52eab8-d036-45c9-beea-3de4c062ea20 req-dd919d84-615c-43ce-8b5b-1936e9bcb54f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:34 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-bf52eab8-d036-45c9-beea-3de4c062ea20 req-dd919d84-615c-43ce-8b5b-1936e9bcb54f service nova] Creating event network-vif-plugged:e42a12d0-d042-4277-83a6-7141c1df1ea2 for instance 4211d816-b8aa-452e-9587-bf131e42d643 on user Apr 13 15:34:34 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-bf52eab8-d036-45c9-beea-3de4c062ea20 req-dd919d84-615c-43ce-8b5b-1936e9bcb54f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028093 Apr 13 15:34:34 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 324/964] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:34:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:34:37 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-0b906b02-ae52-4e7b-903d-fe978ca13fcb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:34:37 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-0b906b02-ae52-4e7b-903d-fe978ca13fcb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:34:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0b906b02-ae52-4e7b-903d-fe978ca13fcb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0b906b02-ae52-4e7b-903d-fe978ca13fcb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0b906b02-ae52-4e7b-903d-fe978ca13fcb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0b906b02-ae52-4e7b-903d-fe978ca13fcb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0b906b02-ae52-4e7b-903d-fe978ca13fcb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-0b906b02-ae52-4e7b-903d-fe978ca13fcb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:37 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-0b906b02-ae52-4e7b-903d-fe978ca13fcb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:34:37 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-0b906b02-ae52-4e7b-903d-fe978ca13fcb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227" status: 200 len: 1393 microversion: 2.1 time: 0.148762 Apr 13 15:34:37 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 323/965] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:34:37 2023] GET /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227 => generated 1393 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:34:41 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-1c42f440-d31a-4aeb-87fb-7b314b63cf7b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:34:41 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-1c42f440-d31a-4aeb-87fb-7b314b63cf7b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:34:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1c42f440-d31a-4aeb-87fb-7b314b63cf7b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1c42f440-d31a-4aeb-87fb-7b314b63cf7b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1c42f440-d31a-4aeb-87fb-7b314b63cf7b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1c42f440-d31a-4aeb-87fb-7b314b63cf7b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1c42f440-d31a-4aeb-87fb-7b314b63cf7b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1c42f440-d31a-4aeb-87fb-7b314b63cf7b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:41 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-1c42f440-d31a-4aeb-87fb-7b314b63cf7b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044249 Apr 13 15:34:41 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 319/966] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 15:34:41 2023] GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:34:41 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:34:41 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:34:41 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:41 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:41 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:41 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:41 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:41 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:41 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Going to try to terminate instance {{(pid=61873) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:34:41 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87" status: 204 len: 0 microversion: 2.20 time: 0.103147 Apr 13 15:34:41 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 325/967] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 15:34:41 2023] DELETE /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 15:34:41 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-cb99ed2a-4d96-4772-ba70-b0524bb4ee9c tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:34:41 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-cb99ed2a-4d96-4772-ba70-b0524bb4ee9c tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:34:41 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cb99ed2a-4d96-4772-ba70-b0524bb4ee9c tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:41 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cb99ed2a-4d96-4772-ba70-b0524bb4ee9c tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:41 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cb99ed2a-4d96-4772-ba70-b0524bb4ee9c tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:41 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cb99ed2a-4d96-4772-ba70-b0524bb4ee9c tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:41 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cb99ed2a-4d96-4772-ba70-b0524bb4ee9c tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:41 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cb99ed2a-4d96-4772-ba70-b0524bb4ee9c tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:41 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-cb99ed2a-4d96-4772-ba70-b0524bb4ee9c tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:34:41 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-cb99ed2a-4d96-4772-ba70-b0524bb4ee9c tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:34:41 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-cb99ed2a-4d96-4772-ba70-b0524bb4ee9c tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:34:41 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-cb99ed2a-4d96-4772-ba70-b0524bb4ee9c tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87" status: 200 len: 1712 microversion: 2.20 time: 0.167787 Apr 13 15:34:41 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 324/968] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:34:41 2023] GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87 => generated 1712 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 13 15:34:41 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-884ae4af-eb49-460d-90d4-03ae8ad3bb0f req-4755d4b9-fe9d-4342-8c50-ac1b24f9060e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9761101e-4bce-4e7b-8137-569bf8d27f87", "name": "network-vif-unplugged", "status": "completed", "tag": "e2eabaa4-a35d-433f-850e-949af795e7ed"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:34:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-884ae4af-eb49-460d-90d4-03ae8ad3bb0f req-4755d4b9-fe9d-4342-8c50-ac1b24f9060e service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-884ae4af-eb49-460d-90d4-03ae8ad3bb0f req-4755d4b9-fe9d-4342-8c50-ac1b24f9060e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-884ae4af-eb49-460d-90d4-03ae8ad3bb0f req-4755d4b9-fe9d-4342-8c50-ac1b24f9060e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:41 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-884ae4af-eb49-460d-90d4-03ae8ad3bb0f req-4755d4b9-fe9d-4342-8c50-ac1b24f9060e service nova] Creating event network-vif-unplugged:e2eabaa4-a35d-433f-850e-949af795e7ed for instance 9761101e-4bce-4e7b-8137-569bf8d27f87 on user Apr 13 15:34:41 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-884ae4af-eb49-460d-90d4-03ae8ad3bb0f req-4755d4b9-fe9d-4342-8c50-ac1b24f9060e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031057 Apr 13 15:34:41 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 320/969] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:34:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:34:43 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-f75bd36b-8dfa-40c1-8087-2242be0d0d07 req-6d2f56fa-fba6-4de6-baac-74e5a99bb2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9761101e-4bce-4e7b-8137-569bf8d27f87", "name": "network-vif-deleted", "tag": "e2eabaa4-a35d-433f-850e-949af795e7ed"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:34:43 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-f75bd36b-8dfa-40c1-8087-2242be0d0d07 req-6d2f56fa-fba6-4de6-baac-74e5a99bb2e3 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:43 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-f75bd36b-8dfa-40c1-8087-2242be0d0d07 req-6d2f56fa-fba6-4de6-baac-74e5a99bb2e3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:43 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-f75bd36b-8dfa-40c1-8087-2242be0d0d07 req-6d2f56fa-fba6-4de6-baac-74e5a99bb2e3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:43 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-f75bd36b-8dfa-40c1-8087-2242be0d0d07 req-6d2f56fa-fba6-4de6-baac-74e5a99bb2e3 service nova] Creating event network-vif-deleted:e2eabaa4-a35d-433f-850e-949af795e7ed for instance 9761101e-4bce-4e7b-8137-569bf8d27f87 on user Apr 13 15:34:43 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-f75bd36b-8dfa-40c1-8087-2242be0d0d07 req-6d2f56fa-fba6-4de6-baac-74e5a99bb2e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031108 Apr 13 15:34:43 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 326/970] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:34:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:34:43 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-fedfa2f4-75b2-40d9-ad27-6b1292bec5d3 req-fe95db45-44da-4aa6-8347-cd19715e24b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9761101e-4bce-4e7b-8137-569bf8d27f87", "name": "network-vif-plugged", "status": "completed", "tag": "e2eabaa4-a35d-433f-850e-949af795e7ed"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:34:43 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-fedfa2f4-75b2-40d9-ad27-6b1292bec5d3 req-fe95db45-44da-4aa6-8347-cd19715e24b2 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:43 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-fedfa2f4-75b2-40d9-ad27-6b1292bec5d3 req-fe95db45-44da-4aa6-8347-cd19715e24b2 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:43 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-fedfa2f4-75b2-40d9-ad27-6b1292bec5d3 req-fe95db45-44da-4aa6-8347-cd19715e24b2 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:43 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-fedfa2f4-75b2-40d9-ad27-6b1292bec5d3 req-fe95db45-44da-4aa6-8347-cd19715e24b2 service nova] Creating event network-vif-plugged:e2eabaa4-a35d-433f-850e-949af795e7ed for instance 9761101e-4bce-4e7b-8137-569bf8d27f87 on user Apr 13 15:34:43 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-fedfa2f4-75b2-40d9-ad27-6b1292bec5d3 req-fe95db45-44da-4aa6-8347-cd19715e24b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028072 Apr 13 15:34:43 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 325/971] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:34:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:34:56 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:34:56 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:34:56 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-86a128b1-f3dc-4cfc-a2e5-b8653b8ec2a9 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:34:56 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-86a128b1-f3dc-4cfc-a2e5-b8653b8ec2a9 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:34:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-86a128b1-f3dc-4cfc-a2e5-b8653b8ec2a9 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-86a128b1-f3dc-4cfc-a2e5-b8653b8ec2a9 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-86a128b1-f3dc-4cfc-a2e5-b8653b8ec2a9 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-86a128b1-f3dc-4cfc-a2e5-b8653b8ec2a9 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:34:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-86a128b1-f3dc-4cfc-a2e5-b8653b8ec2a9 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:34:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-86a128b1-f3dc-4cfc-a2e5-b8653b8ec2a9 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:34:56 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-86a128b1-f3dc-4cfc-a2e5-b8653b8ec2a9 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] HTTP exception thrown: Instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 could not be found. Apr 13 15:34:56 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-86a128b1-f3dc-4cfc-a2e5-b8653b8ec2a9 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Request method failure captured: Apr 13 15:34:56 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/22bb22bd-efa8-4679-979a-dd0ce28a79e3 HTTP/1.1 Apr 13 15:34:56 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:34:56 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:34:56 user devstack@n-api.service[61871]: Connection: close Apr 13 15:34:56 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:34:56 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:34:56 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:34:56 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:34:56 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:34:56 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOB7kKQ44jHGyRwLCnKetXuptxn0znpv1SCvdmpcfSLebOWuTJbaDmT9s8_KTZV_Nzw6Nf9PmJBaiMYXvtuNBpo17X0Kcfru9DbFvcC33q8yjZQ1ouKJDxhQ0wQ0H-ndflDRipvny3s7y8abf-HRxzRrh7eJlHlgT1EnBB5Pboqyao0A Apr 13 15:34:56 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:34:56 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:34:56 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:34:56 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:34:56 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:34:56 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:34:56 user devstack@n-api.service[61871]: X-Project-Id: 1ac07b9454744832b26bf6bd126763ec Apr 13 15:34:56 user devstack@n-api.service[61871]: X-Project-Name: tempest-ServersNegativeTestJSON-187650290 Apr 13 15:34:56 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:34:56 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:34:56 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1ac07b9454744832b26bf6bd126763ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ac07b9454744832b26bf6bd126763ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ac07b9454744832b26bf6bd126763ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:34:56 user devstack@n-api.service[61871]: X-Tenant: tempest-ServersNegativeTestJSON-187650290 Apr 13 15:34:56 user devstack@n-api.service[61871]: X-Tenant-Id: 1ac07b9454744832b26bf6bd126763ec Apr 13 15:34:56 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187650290 Apr 13 15:34:56 user devstack@n-api.service[61871]: X-User: tempest-ServersNegativeTestJSON-187650290-project-member Apr 13 15:34:56 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:34:56 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:34:56 user devstack@n-api.service[61871]: X-User-Id: 3a6955546e4f4292a25acad709d27953 Apr 13 15:34:56 user devstack@n-api.service[61871]: X-User-Name: tempest-ServersNegativeTestJSON-187650290-project-member Apr 13 15:34:56 user devstack@n-api.service[61871]: method: > Apr 13 15:34:56 user devstack@n-api.service[61871]: exception: Instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 could not be found. Apr 13 15:34:56 user devstack@n-api.service[61871]: action_args: {'id': '22bb22bd-efa8-4679-979a-dd0ce28a79e3'} Apr 13 15:34:56 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 could not be found. Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 could not be found. Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 could not be found. Apr 13 15:34:56 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:34:56 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-86a128b1-f3dc-4cfc-a2e5-b8653b8ec2a9 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Returning 404 to user: Instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:34:56 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-86a128b1-f3dc-4cfc-a2e5-b8653b8ec2a9 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22bb22bd-efa8-4679-979a-dd0ce28a79e3" status: 404 len: 111 microversion: 2.1 time: 0.036241 Apr 13 15:34:56 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 321/972] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:34:56 2023] GET /compute/v2.1/servers/22bb22bd-efa8-4679-979a-dd0ce28a79e3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-52e9a5f2-30e2-4181-9191-60342bdc6ff0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-52e9a5f2-30e2-4181-9191-60342bdc6ff0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-52e9a5f2-30e2-4181-9191-60342bdc6ff0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-52e9a5f2-30e2-4181-9191-60342bdc6ff0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-52e9a5f2-30e2-4181-9191-60342bdc6ff0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-52e9a5f2-30e2-4181-9191-60342bdc6ff0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-52e9a5f2-30e2-4181-9191-60342bdc6ff0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-52e9a5f2-30e2-4181-9191-60342bdc6ff0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:22 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-52e9a5f2-30e2-4181-9191-60342bdc6ff0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] HTTP exception thrown: Instance 4211d816-b8aa-452e-9587-bf131e42d643 could not be found. Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-52e9a5f2-30e2-4181-9191-60342bdc6ff0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Request method failure captured: Apr 13 15:35:22 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643 HTTP/1.1 Apr 13 15:35:22 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:35:22 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:35:22 user devstack@n-api.service[61873]: Connection: close Apr 13 15:35:22 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:35:22 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:35:22 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:35:22 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:35:22 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:35:22 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBurKJYr8ku-a9sArMgKGf_zkPYe813RFy3hL9gqm2lA8nA6HuO5sIKmld2K9ueWSJVv5odFcnKlFc37QtLWXaIxLt9FyBSC8ppfxnpaWtL0HffjHjpcF-R5kmgCDC1i3LhNS5BS_s2X-f1QR1QIvxPG-vNqAgSRbD8S_rxbpklmlLk Apr 13 15:35:22 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:35:22 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:35:22 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:35:22 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:35:22 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:35:22 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:35:22 user devstack@n-api.service[61873]: X-Project-Id: 9154e4239a1a42a3820c27563ba0513f Apr 13 15:35:22 user devstack@n-api.service[61873]: X-Project-Name: tempest-ServerActionsTestJSON-423674903 Apr 13 15:35:22 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:35:22 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:35:22 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:35:22 user devstack@n-api.service[61873]: X-Tenant: tempest-ServerActionsTestJSON-423674903 Apr 13 15:35:22 user devstack@n-api.service[61873]: X-Tenant-Id: 9154e4239a1a42a3820c27563ba0513f Apr 13 15:35:22 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-ServerActionsTestJSON-423674903 Apr 13 15:35:22 user devstack@n-api.service[61873]: X-User: tempest-ServerActionsTestJSON-423674903-project-member Apr 13 15:35:22 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:35:22 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:35:22 user devstack@n-api.service[61873]: X-User-Id: 3c12c62d4137473596571e523163e718 Apr 13 15:35:22 user devstack@n-api.service[61873]: X-User-Name: tempest-ServerActionsTestJSON-423674903-project-member Apr 13 15:35:22 user devstack@n-api.service[61873]: method: > Apr 13 15:35:22 user devstack@n-api.service[61873]: exception: Instance 4211d816-b8aa-452e-9587-bf131e42d643 could not be found. Apr 13 15:35:22 user devstack@n-api.service[61873]: action_args: {'id': '4211d816-b8aa-452e-9587-bf131e42d643'} Apr 13 15:35:22 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4211d816-b8aa-452e-9587-bf131e42d643 could not be found. Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4211d816-b8aa-452e-9587-bf131e42d643 could not be found. Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4211d816-b8aa-452e-9587-bf131e42d643 could not be found. Apr 13 15:35:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-52e9a5f2-30e2-4181-9191-60342bdc6ff0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Returning 404 to user: Instance 4211d816-b8aa-452e-9587-bf131e42d643 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:35:22 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-52e9a5f2-30e2-4181-9191-60342bdc6ff0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643" status: 404 len: 111 microversion: 2.1 time: 0.040929 Apr 13 15:35:22 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 327/973] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:35:22 2023] GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:35:22 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=8 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:35:22 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=16 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:35:22 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-6512f1b9-bfd1-4bca-a889-ffca62c05e02 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:35:22 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-6512f1b9-bfd1-4bca-a889-ffca62c05e02 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:35:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6512f1b9-bfd1-4bca-a889-ffca62c05e02 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6512f1b9-bfd1-4bca-a889-ffca62c05e02 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6512f1b9-bfd1-4bca-a889-ffca62c05e02 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6512f1b9-bfd1-4bca-a889-ffca62c05e02 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6512f1b9-bfd1-4bca-a889-ffca62c05e02 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:22 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6512f1b9-bfd1-4bca-a889-ffca62c05e02 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:22 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-6512f1b9-bfd1-4bca-a889-ffca62c05e02 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] HTTP exception thrown: Instance 4211d816-b8aa-452e-9587-bf131e42d643 could not be found. Apr 13 15:35:22 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-6512f1b9-bfd1-4bca-a889-ffca62c05e02 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Request method failure captured: Apr 13 15:35:22 user devstack@n-api.service[61872]: request: DELETE /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643 HTTP/1.1 Apr 13 15:35:22 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:35:22 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:35:22 user devstack@n-api.service[61872]: Connection: close Apr 13 15:35:22 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:35:22 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:35:22 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:35:22 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:35:22 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:35:22 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBurKJYr8ku-a9sArMgKGf_zkPYe813RFy3hL9gqm2lA8nA6HuO5sIKmld2K9ueWSJVv5odFcnKlFc37QtLWXaIxLt9FyBSC8ppfxnpaWtL0HffjHjpcF-R5kmgCDC1i3LhNS5BS_s2X-f1QR1QIvxPG-vNqAgSRbD8S_rxbpklmlLk Apr 13 15:35:22 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:35:22 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:35:22 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:35:22 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:35:22 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:35:22 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:35:22 user devstack@n-api.service[61872]: X-Project-Id: 9154e4239a1a42a3820c27563ba0513f Apr 13 15:35:22 user devstack@n-api.service[61872]: X-Project-Name: tempest-ServerActionsTestJSON-423674903 Apr 13 15:35:22 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:35:22 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:35:22 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:35:22 user devstack@n-api.service[61872]: X-Tenant: tempest-ServerActionsTestJSON-423674903 Apr 13 15:35:22 user devstack@n-api.service[61872]: X-Tenant-Id: 9154e4239a1a42a3820c27563ba0513f Apr 13 15:35:22 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-ServerActionsTestJSON-423674903 Apr 13 15:35:22 user devstack@n-api.service[61872]: X-User: tempest-ServerActionsTestJSON-423674903-project-member Apr 13 15:35:22 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:35:22 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:35:22 user devstack@n-api.service[61872]: X-User-Id: 3c12c62d4137473596571e523163e718 Apr 13 15:35:22 user devstack@n-api.service[61872]: X-User-Name: tempest-ServerActionsTestJSON-423674903-project-member Apr 13 15:35:22 user devstack@n-api.service[61872]: method: > Apr 13 15:35:22 user devstack@n-api.service[61872]: exception: Instance 4211d816-b8aa-452e-9587-bf131e42d643 could not be found. Apr 13 15:35:22 user devstack@n-api.service[61872]: action_args: {'id': '4211d816-b8aa-452e-9587-bf131e42d643'} Apr 13 15:35:22 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4211d816-b8aa-452e-9587-bf131e42d643 could not be found. Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4211d816-b8aa-452e-9587-bf131e42d643 could not be found. Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4211d816-b8aa-452e-9587-bf131e42d643 could not be found. Apr 13 15:35:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:35:22 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-6512f1b9-bfd1-4bca-a889-ffca62c05e02 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Returning 404 to user: Instance 4211d816-b8aa-452e-9587-bf131e42d643 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:35:22 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-6512f1b9-bfd1-4bca-a889-ffca62c05e02 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643" status: 404 len: 111 microversion: 2.1 time: 0.037548 Apr 13 15:35:22 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 326/974] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:35:22 2023] DELETE /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:35:22 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-28e5fbe0-02e3-4a95-bb1f-3e8ac2817a90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:35:22 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-28e5fbe0-02e3-4a95-bb1f-3e8ac2817a90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:35:22 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:35:22 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:35:22 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-28e5fbe0-02e3-4a95-bb1f-3e8ac2817a90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:22 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-28e5fbe0-02e3-4a95-bb1f-3e8ac2817a90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:22 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-28e5fbe0-02e3-4a95-bb1f-3e8ac2817a90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:22 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-28e5fbe0-02e3-4a95-bb1f-3e8ac2817a90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:22 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-28e5fbe0-02e3-4a95-bb1f-3e8ac2817a90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:22 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-28e5fbe0-02e3-4a95-bb1f-3e8ac2817a90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:22 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-28e5fbe0-02e3-4a95-bb1f-3e8ac2817a90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] HTTP exception thrown: Instance 4211d816-b8aa-452e-9587-bf131e42d643 could not be found. Apr 13 15:35:22 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-28e5fbe0-02e3-4a95-bb1f-3e8ac2817a90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Request method failure captured: Apr 13 15:35:22 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643 HTTP/1.1 Apr 13 15:35:22 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:35:22 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:35:22 user devstack@n-api.service[61871]: Connection: close Apr 13 15:35:22 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:35:22 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:35:22 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:35:22 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:35:22 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:35:22 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBurKJYr8ku-a9sArMgKGf_zkPYe813RFy3hL9gqm2lA8nA6HuO5sIKmld2K9ueWSJVv5odFcnKlFc37QtLWXaIxLt9FyBSC8ppfxnpaWtL0HffjHjpcF-R5kmgCDC1i3LhNS5BS_s2X-f1QR1QIvxPG-vNqAgSRbD8S_rxbpklmlLk Apr 13 15:35:22 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:35:22 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:35:22 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:35:22 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:35:22 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:35:22 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:35:22 user devstack@n-api.service[61871]: X-Project-Id: 9154e4239a1a42a3820c27563ba0513f Apr 13 15:35:22 user devstack@n-api.service[61871]: X-Project-Name: tempest-ServerActionsTestJSON-423674903 Apr 13 15:35:22 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:35:22 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:35:22 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:35:22 user devstack@n-api.service[61871]: X-Tenant: tempest-ServerActionsTestJSON-423674903 Apr 13 15:35:22 user devstack@n-api.service[61871]: X-Tenant-Id: 9154e4239a1a42a3820c27563ba0513f Apr 13 15:35:22 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-ServerActionsTestJSON-423674903 Apr 13 15:35:22 user devstack@n-api.service[61871]: X-User: tempest-ServerActionsTestJSON-423674903-project-member Apr 13 15:35:22 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:35:22 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:35:22 user devstack@n-api.service[61871]: X-User-Id: 3c12c62d4137473596571e523163e718 Apr 13 15:35:22 user devstack@n-api.service[61871]: X-User-Name: tempest-ServerActionsTestJSON-423674903-project-member Apr 13 15:35:22 user devstack@n-api.service[61871]: method: > Apr 13 15:35:22 user devstack@n-api.service[61871]: exception: Instance 4211d816-b8aa-452e-9587-bf131e42d643 could not be found. Apr 13 15:35:22 user devstack@n-api.service[61871]: action_args: {'id': '4211d816-b8aa-452e-9587-bf131e42d643'} Apr 13 15:35:22 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4211d816-b8aa-452e-9587-bf131e42d643 could not be found. Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4211d816-b8aa-452e-9587-bf131e42d643 could not be found. Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4211d816-b8aa-452e-9587-bf131e42d643 could not be found. Apr 13 15:35:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:35:22 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-28e5fbe0-02e3-4a95-bb1f-3e8ac2817a90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Returning 404 to user: Instance 4211d816-b8aa-452e-9587-bf131e42d643 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:35:22 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-28e5fbe0-02e3-4a95-bb1f-3e8ac2817a90 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643" status: 404 len: 111 microversion: 2.1 time: 0.032268 Apr 13 15:35:22 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 322/975] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:35:22 2023] GET /compute/v2.1/servers/4211d816-b8aa-452e-9587-bf131e42d643 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:22 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Going to try to terminate instance {{(pid=61873) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:35:23 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/58e8e652-d56c-45b6-92ff-a50406ea48e9" status: 204 len: 0 microversion: 2.1 time: 0.235574 Apr 13 15:35:23 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 328/976] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:35:22 2023] DELETE /compute/v2.1/servers/58e8e652-d56c-45b6-92ff-a50406ea48e9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:35:23 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-49adb97a-3a14-47fe-bbaf-fe338cbff39e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:35:23 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-49adb97a-3a14-47fe-bbaf-fe338cbff39e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:35:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-49adb97a-3a14-47fe-bbaf-fe338cbff39e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-49adb97a-3a14-47fe-bbaf-fe338cbff39e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-49adb97a-3a14-47fe-bbaf-fe338cbff39e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-49adb97a-3a14-47fe-bbaf-fe338cbff39e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-49adb97a-3a14-47fe-bbaf-fe338cbff39e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:23 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-49adb97a-3a14-47fe-bbaf-fe338cbff39e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:23 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-49adb97a-3a14-47fe-bbaf-fe338cbff39e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:35:23 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-49adb97a-3a14-47fe-bbaf-fe338cbff39e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58e8e652-d56c-45b6-92ff-a50406ea48e9" status: 200 len: 1544 microversion: 2.1 time: 0.196005 Apr 13 15:35:23 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 327/977] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:35:23 2023] GET /compute/v2.1/servers/58e8e652-d56c-45b6-92ff-a50406ea48e9 => generated 1544 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:35:23 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-6f004e5a-9478-45f3-a541-ce978cbbdcfd req-c2008046-1385-41e1-8b3b-a9d639100adf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e8e652-d56c-45b6-92ff-a50406ea48e9", "name": "network-vif-unplugged", "status": "completed", "tag": "018bebd6-4323-4f9d-8c6d-6da9a7934a97"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:35:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-6f004e5a-9478-45f3-a541-ce978cbbdcfd req-c2008046-1385-41e1-8b3b-a9d639100adf service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-6f004e5a-9478-45f3-a541-ce978cbbdcfd req-c2008046-1385-41e1-8b3b-a9d639100adf service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-6f004e5a-9478-45f3-a541-ce978cbbdcfd req-c2008046-1385-41e1-8b3b-a9d639100adf service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:23 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-6f004e5a-9478-45f3-a541-ce978cbbdcfd req-c2008046-1385-41e1-8b3b-a9d639100adf service nova] Creating event network-vif-unplugged:018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 on user Apr 13 15:35:23 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-6f004e5a-9478-45f3-a541-ce978cbbdcfd req-c2008046-1385-41e1-8b3b-a9d639100adf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032044 Apr 13 15:35:23 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 323/978] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:35:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:35:24 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-2753de40-5313-4a56-b1a6-3aaa49e0fdb0 req-8e006b07-952e-4d18-81e4-744d34acefa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e8e652-d56c-45b6-92ff-a50406ea48e9", "name": "network-vif-deleted", "tag": "018bebd6-4323-4f9d-8c6d-6da9a7934a97"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:35:24 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-2753de40-5313-4a56-b1a6-3aaa49e0fdb0 req-8e006b07-952e-4d18-81e4-744d34acefa7 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:24 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-2753de40-5313-4a56-b1a6-3aaa49e0fdb0 req-8e006b07-952e-4d18-81e4-744d34acefa7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:24 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-2753de40-5313-4a56-b1a6-3aaa49e0fdb0 req-8e006b07-952e-4d18-81e4-744d34acefa7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:24 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-2753de40-5313-4a56-b1a6-3aaa49e0fdb0 req-8e006b07-952e-4d18-81e4-744d34acefa7 service nova] Creating event network-vif-deleted:018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 on user Apr 13 15:35:24 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-2753de40-5313-4a56-b1a6-3aaa49e0fdb0 req-8e006b07-952e-4d18-81e4-744d34acefa7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033556 Apr 13 15:35:24 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 329/979] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:35:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:35:25 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e8e652-d56c-45b6-92ff-a50406ea48e9", "name": "network-vif-plugged", "status": "completed", "tag": "018bebd6-4323-4f9d-8c6d-6da9a7934a97"}, {"server_uuid": "58e8e652-d56c-45b6-92ff-a50406ea48e9", "name": "network-vif-plugged", "status": "completed", "tag": "018bebd6-4323-4f9d-8c6d-6da9a7934a97"}, {"server_uuid": "58e8e652-d56c-45b6-92ff-a50406ea48e9", "name": "network-vif-plugged", "status": "completed", "tag": "018bebd6-4323-4f9d-8c6d-6da9a7934a97"}, {"server_uuid": "58e8e652-d56c-45b6-92ff-a50406ea48e9", "name": "network-vif-unplugged", "status": "completed", "tag": "018bebd6-4323-4f9d-8c6d-6da9a7934a97"}, {"server_uuid": "58e8e652-d56c-45b6-92ff-a50406ea48e9", "name": "network-vif-plugged", "status": "completed", "tag": "018bebd6-4323-4f9d-8c6d-6da9a7934a97"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:35:25 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:25 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:25 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:25 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Creating event network-vif-plugged:018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 on user Apr 13 15:35:25 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Creating event network-vif-plugged:018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 on user Apr 13 15:35:25 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Creating event network-vif-plugged:018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 on user Apr 13 15:35:25 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Creating event network-vif-unplugged:018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 on user Apr 13 15:35:25 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Creating event network-vif-plugged:018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 on user Apr 13 15:35:25 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.031889 Apr 13 15:35:25 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 328/980] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:35:25 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:35:31 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-09e1c4be-a1b8-44f8-bec0-8f2b023bf502 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:35:31 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-09e1c4be-a1b8-44f8-bec0-8f2b023bf502 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:35:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-09e1c4be-a1b8-44f8-bec0-8f2b023bf502 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-09e1c4be-a1b8-44f8-bec0-8f2b023bf502 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-09e1c4be-a1b8-44f8-bec0-8f2b023bf502 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-09e1c4be-a1b8-44f8-bec0-8f2b023bf502 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-09e1c4be-a1b8-44f8-bec0-8f2b023bf502 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:31 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-09e1c4be-a1b8-44f8-bec0-8f2b023bf502 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:31 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-09e1c4be-a1b8-44f8-bec0-8f2b023bf502 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] HTTP exception thrown: Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 could not be found. Apr 13 15:35:31 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-09e1c4be-a1b8-44f8-bec0-8f2b023bf502 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Request method failure captured: Apr 13 15:35:31 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87 HTTP/1.1 Apr 13 15:35:31 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:35:31 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:35:31 user devstack@n-api.service[61871]: Connection: close Apr 13 15:35:31 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:35:31 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:35:31 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:35:31 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:35:31 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:35:31 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOB-LGbKTLlqYQRDBIHqKQhR86k95R9MEB10QZuKYQqypeQa2aX2FvbirbV0mEwCe81--ds6HHp15m2ICVFfvhCf0lnr24yNr4ZTYgiv5Aw441CKEcYKKjLwLA6WSi0icvfuY63zpIXQFBms6BD1I2A2LGtFeZPX2M6gUhp1JxXHsxnM Apr 13 15:35:31 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:35:31 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:35:31 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:35:31 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:35:31 user devstack@n-api.service[61871]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 15:35:31 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:35:31 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:35:31 user devstack@n-api.service[61871]: X-Project-Id: 51df4613a6664a0fab857a9a83b6df62 Apr 13 15:35:31 user devstack@n-api.service[61871]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1608248430 Apr 13 15:35:31 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:35:31 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:35:31 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/51df4613a6664a0fab857a9a83b6df62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51df4613a6664a0fab857a9a83b6df62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51df4613a6664a0fab857a9a83b6df62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:35:31 user devstack@n-api.service[61871]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1608248430 Apr 13 15:35:31 user devstack@n-api.service[61871]: X-Tenant-Id: 51df4613a6664a0fab857a9a83b6df62 Apr 13 15:35:31 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1608248430 Apr 13 15:35:31 user devstack@n-api.service[61871]: X-User: tempest-AttachVolumeShelveTestJSON-1608248430-project-member Apr 13 15:35:31 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:35:31 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:35:31 user devstack@n-api.service[61871]: X-User-Id: a0bc1b61d8dc44aa8460fe2cd510c0a4 Apr 13 15:35:31 user devstack@n-api.service[61871]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1608248430-project-member Apr 13 15:35:31 user devstack@n-api.service[61871]: method: > Apr 13 15:35:31 user devstack@n-api.service[61871]: exception: Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 could not be found. Apr 13 15:35:31 user devstack@n-api.service[61871]: action_args: {'id': '9761101e-4bce-4e7b-8137-569bf8d27f87'} Apr 13 15:35:31 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 could not be found. Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 could not be found. Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 could not be found. Apr 13 15:35:31 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:35:31 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-09e1c4be-a1b8-44f8-bec0-8f2b023bf502 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Returning 404 to user: Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:35:31 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-09e1c4be-a1b8-44f8-bec0-8f2b023bf502 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87" status: 404 len: 111 microversion: 2.20 time: 0.043666 Apr 13 15:35:31 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 324/981] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:35:31 2023] GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:35:31 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-89d5e2d0-cd12-4987-af55-f82a691a30e7 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '.version_select at 0x7f3a8bd4f5b0>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:35:31 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-89d5e2d0-cd12-4987-af55-f82a691a30e7 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306550106" status: 204 len: 0 microversion: 2.20 time: 0.031445 Apr 13 15:35:31 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 330/982] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 13 15:35:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306550106 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 15:35:32 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-58cc4bb6-40e0-455d-8a1d-05e64033291d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Action: 'create', calling method: .version_select at 0x7f3a8fa5e8c0>, body: {"keypair": {"name": "tempest-keypair-249143367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnB1XKsk+V/s+8svM9sTYLSdCjPIha2/SxAlkQCj7RRjLtDmMIHKWKDxVW7nV/0+Ei3Tt4l3pDA6FtDGaEcY6JOCIXBZUCsdZhUWv5y0PmkdIGRBBVocQPBaKYwc7DDpg=="}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:35:32 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-58cc4bb6-40e0-455d-8a1d-05e64033291d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Getting quotas for project 51df4613a6664a0fab857a9a83b6df62. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:35:32 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-58cc4bb6-40e0-455d-8a1d-05e64033291d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Getting quotas for user a0bc1b61d8dc44aa8460fe2cd510c0a4 and project 51df4613a6664a0fab857a9a83b6df62. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:35:32 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-58cc4bb6-40e0-455d-8a1d-05e64033291d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.057601 Apr 13 15:35:32 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 329/983] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 15:35:32 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 15:35:34 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1461623425", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a"}], "security_groups": [{"name": "tempest-securitygroup--1656909272"}], "key_name": "tempest-keypair-249143367", "user_data": "}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:35:34 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] validate_networks() for [('1d3a06de-0d0e-4486-b2f4-a1de430fcd8a', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:35:34 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:35:34 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:35:34 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:35:34 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:35:34 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:35:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:34 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Getting quotas for project 51df4613a6664a0fab857a9a83b6df62. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:35:34 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Getting quotas for user a0bc1b61d8dc44aa8460fe2cd510c0a4 and project 51df4613a6664a0fab857a9a83b6df62. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:35:34 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:35:34 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:35:34 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.541161 Apr 13 15:35:34 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 325/984] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 15:35:34 2023] POST /compute/v2.1/servers => generated 400 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 15:35:34 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:35:34 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7560c16a-5e71-43cd-b6ba-37bedec276e0 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:35:34 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-7560c16a-5e71-43cd-b6ba-37bedec276e0 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:35:34 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-7560c16a-5e71-43cd-b6ba-37bedec276e0 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:35:34 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-7560c16a-5e71-43cd-b6ba-37bedec276e0 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:35:34 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-7560c16a-5e71-43cd-b6ba-37bedec276e0 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:35:34 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7560c16a-5e71-43cd-b6ba-37bedec276e0 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380" status: 200 len: 1275 microversion: 2.20 time: 0.088379 Apr 13 15:35:34 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 331/985] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:35:34 2023] GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380 => generated 1275 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:35:37 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=10 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:35:37 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-5475a116-a23d-4f3c-8f37-e9fec4c1093e req-ab7a3f65-14a6-4901-bbff-2ad6a933f72d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b179d3-712f-47bc-94ad-387c8ca77380", "tag": "1cb2ae52-e4fa-4627-b3f3-301af5732358"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:35:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-5475a116-a23d-4f3c-8f37-e9fec4c1093e req-ab7a3f65-14a6-4901-bbff-2ad6a933f72d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-5475a116-a23d-4f3c-8f37-e9fec4c1093e req-ab7a3f65-14a6-4901-bbff-2ad6a933f72d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-5475a116-a23d-4f3c-8f37-e9fec4c1093e req-ab7a3f65-14a6-4901-bbff-2ad6a933f72d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:37 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-5475a116-a23d-4f3c-8f37-e9fec4c1093e req-ab7a3f65-14a6-4901-bbff-2ad6a933f72d service nova] Creating event network-changed:1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance 32b179d3-712f-47bc-94ad-387c8ca77380 on user Apr 13 15:35:37 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-5475a116-a23d-4f3c-8f37-e9fec4c1093e req-ab7a3f65-14a6-4901-bbff-2ad6a933f72d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032874 Apr 13 15:35:37 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 330/986] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:35:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:35:37 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-1d3ec087-7143-4eab-9d5d-18adbcc3ef3b tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:35:37 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-1d3ec087-7143-4eab-9d5d-18adbcc3ef3b tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:35:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1d3ec087-7143-4eab-9d5d-18adbcc3ef3b tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1d3ec087-7143-4eab-9d5d-18adbcc3ef3b tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1d3ec087-7143-4eab-9d5d-18adbcc3ef3b tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1d3ec087-7143-4eab-9d5d-18adbcc3ef3b tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1d3ec087-7143-4eab-9d5d-18adbcc3ef3b tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1d3ec087-7143-4eab-9d5d-18adbcc3ef3b tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:37 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-1d3ec087-7143-4eab-9d5d-18adbcc3ef3b tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:35:37 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-1d3ec087-7143-4eab-9d5d-18adbcc3ef3b tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227" status: 200 len: 1393 microversion: 2.1 time: 0.176708 Apr 13 15:35:37 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 326/987] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:35:37 2023] GET /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227 => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:35:37 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c8d2f8a0-d893-44a1-84df-9b819d4df690 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1792062222"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:35:37 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-c8d2f8a0-d893-44a1-84df-9b819d4df690 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:35:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c8d2f8a0-d893-44a1-84df-9b819d4df690 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c8d2f8a0-d893-44a1-84df-9b819d4df690 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c8d2f8a0-d893-44a1-84df-9b819d4df690 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c8d2f8a0-d893-44a1-84df-9b819d4df690 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c8d2f8a0-d893-44a1-84df-9b819d4df690 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-c8d2f8a0-d893-44a1-84df-9b819d4df690 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:38 user devstack@n-api.service[61873]: INFO nova.compute.api [None req-c8d2f8a0-d893-44a1-84df-9b819d4df690 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Attempting to quiesce instance before volume snapshot. Apr 13 15:35:38 user devstack@n-api.service[61873]: INFO nova.compute.api [None req-c8d2f8a0-d893-44a1-84df-9b819d4df690 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 13 15:35:38 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-c8d2f8a0-d893-44a1-84df-9b819d4df690 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Creating snapshot from volume 662f5cd6-04ae-41af-8266-365985d19beb. {{(pid=61873) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 13 15:35:39 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-10d39988-1791-4dcc-9a32-62d027e6a05f req-d1450281-1a5a-4075-a718-af28c1834b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b179d3-712f-47bc-94ad-387c8ca77380", "name": "network-vif-plugged", "status": "completed", "tag": "1cb2ae52-e4fa-4627-b3f3-301af5732358"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:35:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-10d39988-1791-4dcc-9a32-62d027e6a05f req-d1450281-1a5a-4075-a718-af28c1834b9e service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-10d39988-1791-4dcc-9a32-62d027e6a05f req-d1450281-1a5a-4075-a718-af28c1834b9e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:39 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-10d39988-1791-4dcc-9a32-62d027e6a05f req-d1450281-1a5a-4075-a718-af28c1834b9e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:39 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-10d39988-1791-4dcc-9a32-62d027e6a05f req-d1450281-1a5a-4075-a718-af28c1834b9e service nova] Creating event network-vif-plugged:1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance 32b179d3-712f-47bc-94ad-387c8ca77380 on user Apr 13 15:35:39 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-10d39988-1791-4dcc-9a32-62d027e6a05f req-d1450281-1a5a-4075-a718-af28c1834b9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043362 Apr 13 15:35:39 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 331/988] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:35:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:35:41 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-c8d2f8a0-d893-44a1-84df-9b819d4df690 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "POST /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227/action" status: 202 len: 0 microversion: 2.1 time: 3.133584 Apr 13 15:35:41 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 332/989] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 15:35:37 2023] POST /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227/action => generated 0 bytes in 3135 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 13 15:35:41 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1243895427", "imageRef": "a8b51e62-45b1-4f4a-b622-38c5e601bfd8", "flavorRef": "42", "networks": [{"uuid": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3"}]}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:35:41 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] validate_networks() for [('66ea8c1a-1c77-4a2a-ab35-64acac4762c3', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:35:41 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-809af43d-bdf7-4133-8795-01bbab3156f1 req-1c495b62-55c8-4e62-b66a-a936aa2bcab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b179d3-712f-47bc-94ad-387c8ca77380", "name": "network-vif-plugged", "status": "completed", "tag": "1cb2ae52-e4fa-4627-b3f3-301af5732358"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:35:41 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-809af43d-bdf7-4133-8795-01bbab3156f1 req-1c495b62-55c8-4e62-b66a-a936aa2bcab3 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:41 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-809af43d-bdf7-4133-8795-01bbab3156f1 req-1c495b62-55c8-4e62-b66a-a936aa2bcab3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:41 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-809af43d-bdf7-4133-8795-01bbab3156f1 req-1c495b62-55c8-4e62-b66a-a936aa2bcab3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:41 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-809af43d-bdf7-4133-8795-01bbab3156f1 req-1c495b62-55c8-4e62-b66a-a936aa2bcab3 service nova] Creating event network-vif-plugged:1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance 32b179d3-712f-47bc-94ad-387c8ca77380 on user Apr 13 15:35:41 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-809af43d-bdf7-4133-8795-01bbab3156f1 req-1c495b62-55c8-4e62-b66a-a936aa2bcab3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039169 Apr 13 15:35:41 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 332/990] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:35:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:35:41 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:35:41 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:35:41 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:35:41 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:35:41 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:35:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:41 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:41 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting quotas for project d5d7f771264c4cd2bc595a2c525082d0. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:35:41 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting quotas for user 0307fb8d127a41079e34355904352231 and project d5d7f771264c4cd2bc595a2c525082d0. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:35:41 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:35:41 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f6d86cc4-e799-4a3d-abb3-e25adf5371bb',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:35:41 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.682941 Apr 13 15:35:41 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 327/991] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:35:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:35:41 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-0043148f-3362-47ce-b038-51839773b67b tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:35:41 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-0043148f-3362-47ce-b038-51839773b67b tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:35:42 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-0043148f-3362-47ce-b038-51839773b67b tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:35:42 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-0043148f-3362-47ce-b038-51839773b67b tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8e5dbae-1051-494e-9383-8d334bcd9f97" status: 200 len: 1224 microversion: 2.1 time: 0.120775 Apr 13 15:35:42 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 333/992] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:35:41 2023] GET /compute/v2.1/servers/a8e5dbae-1051-494e-9383-8d334bcd9f97 => generated 1224 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:35:44 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-3a0fb8bf-815d-4f40-9133-5fb96f22b309 req-b0ea9efb-7200-4311-9c97-4a31d8e9ce20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8e5dbae-1051-494e-9383-8d334bcd9f97", "tag": "68238072-7820-4474-a63e-b28f6e9e9d86"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:35:44 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=4 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:35:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3a0fb8bf-815d-4f40-9133-5fb96f22b309 req-b0ea9efb-7200-4311-9c97-4a31d8e9ce20 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3a0fb8bf-815d-4f40-9133-5fb96f22b309 req-b0ea9efb-7200-4311-9c97-4a31d8e9ce20 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3a0fb8bf-815d-4f40-9133-5fb96f22b309 req-b0ea9efb-7200-4311-9c97-4a31d8e9ce20 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:44 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-3a0fb8bf-815d-4f40-9133-5fb96f22b309 req-b0ea9efb-7200-4311-9c97-4a31d8e9ce20 service nova] Creating event network-changed:68238072-7820-4474-a63e-b28f6e9e9d86 for instance a8e5dbae-1051-494e-9383-8d334bcd9f97 on user Apr 13 15:35:44 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-3a0fb8bf-815d-4f40-9133-5fb96f22b309 req-b0ea9efb-7200-4311-9c97-4a31d8e9ce20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051297 Apr 13 15:35:44 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 333/993] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:35:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:35:46 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-269338813", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "networks": [{"uuid": "aaec5536-e991-4d34-ba54-00b2bd705bd9"}]}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:35:46 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] validate_networks() for [('aaec5536-e991-4d34-ba54-00b2bd705bd9', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:35:47 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:35:47 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:35:47 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:35:47 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:35:47 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:35:47 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:47 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:47 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:47 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:47 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:47 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:47 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Getting quotas for project a0a40f5a9b5e4f3fb8467b6ea304bbe5. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:35:47 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Getting quotas for user 300cbdea17c74a418f50e2d581691ad3 and project a0a40f5a9b5e4f3fb8467b6ea304bbe5. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:35:47 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:35:47 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:35:47 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.467267 Apr 13 15:35:47 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 328/994] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:35:46 2023] POST /compute/v2.1/servers => generated 378 bytes in 469 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:35:47 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-a0bf4e8a-e5f0-4991-b44a-1c96945e106b tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:35:47 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-a0bf4e8a-e5f0-4991-b44a-1c96945e106b tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:35:47 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-a0bf4e8a-e5f0-4991-b44a-1c96945e106b tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300cbdea17c74a418f50e2d581691ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a40f5a9b5e4f3fb8467b6ea304bbe5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:35:47 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-a0bf4e8a-e5f0-4991-b44a-1c96945e106b tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" status: 200 len: 1212 microversion: 2.1 time: 0.059578 Apr 13 15:35:47 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 334/995] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:35:47 2023] GET /compute/v2.1/servers/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd => generated 1212 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:35:49 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-02dd2d5f-2692-4ada-92f6-3361dc9f1910 req-6d0c20bf-7aef-4998-9089-fcc8e329629c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd", "tag": "d9dc5c9c-85d3-406a-be61-8f3cc9354712"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:35:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-02dd2d5f-2692-4ada-92f6-3361dc9f1910 req-6d0c20bf-7aef-4998-9089-fcc8e329629c service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-02dd2d5f-2692-4ada-92f6-3361dc9f1910 req-6d0c20bf-7aef-4998-9089-fcc8e329629c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:49 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-02dd2d5f-2692-4ada-92f6-3361dc9f1910 req-6d0c20bf-7aef-4998-9089-fcc8e329629c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:49 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-02dd2d5f-2692-4ada-92f6-3361dc9f1910 req-6d0c20bf-7aef-4998-9089-fcc8e329629c service nova] Creating event network-changed:d9dc5c9c-85d3-406a-be61-8f3cc9354712 for instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd on user Apr 13 15:35:49 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-02dd2d5f-2692-4ada-92f6-3361dc9f1910 req-6d0c20bf-7aef-4998-9089-fcc8e329629c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030100 Apr 13 15:35:49 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 334/996] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:35:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:35:51 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-61d6595b-caa1-4d0f-84a3-656d6f366618 req-140ac837-69cf-4931-a06e-586ab684779a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd", "name": "network-vif-plugged", "status": "completed", "tag": "d9dc5c9c-85d3-406a-be61-8f3cc9354712"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:35:51 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-61d6595b-caa1-4d0f-84a3-656d6f366618 req-140ac837-69cf-4931-a06e-586ab684779a service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:51 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-61d6595b-caa1-4d0f-84a3-656d6f366618 req-140ac837-69cf-4931-a06e-586ab684779a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:51 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-61d6595b-caa1-4d0f-84a3-656d6f366618 req-140ac837-69cf-4931-a06e-586ab684779a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:51 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-61d6595b-caa1-4d0f-84a3-656d6f366618 req-140ac837-69cf-4931-a06e-586ab684779a service nova] Creating event network-vif-plugged:d9dc5c9c-85d3-406a-be61-8f3cc9354712 for instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd on user Apr 13 15:35:51 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-61d6595b-caa1-4d0f-84a3-656d6f366618 req-140ac837-69cf-4931-a06e-586ab684779a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033439 Apr 13 15:35:51 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 329/997] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:35:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:35:53 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-5b9953a8-214a-4cce-9c03-0a264449ee44 req-ae71faeb-5205-4569-8b4c-66c7f5ec210f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd", "name": "network-vif-plugged", "status": "completed", "tag": "d9dc5c9c-85d3-406a-be61-8f3cc9354712"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:35:53 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:35:53 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:35:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5b9953a8-214a-4cce-9c03-0a264449ee44 req-ae71faeb-5205-4569-8b4c-66c7f5ec210f service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5b9953a8-214a-4cce-9c03-0a264449ee44 req-ae71faeb-5205-4569-8b4c-66c7f5ec210f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:53 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5b9953a8-214a-4cce-9c03-0a264449ee44 req-ae71faeb-5205-4569-8b4c-66c7f5ec210f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:53 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-5b9953a8-214a-4cce-9c03-0a264449ee44 req-ae71faeb-5205-4569-8b4c-66c7f5ec210f service nova] Creating event network-vif-plugged:d9dc5c9c-85d3-406a-be61-8f3cc9354712 for instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd on user Apr 13 15:35:53 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-5b9953a8-214a-4cce-9c03-0a264449ee44 req-ae71faeb-5205-4569-8b4c-66c7f5ec210f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039133 Apr 13 15:35:53 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 335/998] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:35:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:35:56 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-8d2a06c2-bd4f-4e84-bc7d-a8537554f6e1 req-00b7a267-6713-471b-9d7c-8da866e7206e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8e5dbae-1051-494e-9383-8d334bcd9f97", "name": "network-vif-plugged", "status": "completed", "tag": "68238072-7820-4474-a63e-b28f6e9e9d86"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:35:56 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:35:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-8d2a06c2-bd4f-4e84-bc7d-a8537554f6e1 req-00b7a267-6713-471b-9d7c-8da866e7206e service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-8d2a06c2-bd4f-4e84-bc7d-a8537554f6e1 req-00b7a267-6713-471b-9d7c-8da866e7206e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-8d2a06c2-bd4f-4e84-bc7d-a8537554f6e1 req-00b7a267-6713-471b-9d7c-8da866e7206e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:56 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-8d2a06c2-bd4f-4e84-bc7d-a8537554f6e1 req-00b7a267-6713-471b-9d7c-8da866e7206e service nova] Creating event network-vif-plugged:68238072-7820-4474-a63e-b28f6e9e9d86 for instance a8e5dbae-1051-494e-9383-8d334bcd9f97 on user Apr 13 15:35:56 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-8d2a06c2-bd4f-4e84-bc7d-a8537554f6e1 req-00b7a267-6713-471b-9d7c-8da866e7206e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034860 Apr 13 15:35:56 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 335/999] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:35:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:35:58 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:35:58 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=18 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:35:58 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-44e3df66-f471-424f-88aa-5c10a686c5b8 req-4b91ff43-3a0a-4dd9-a8f5-080bcaca2ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8e5dbae-1051-494e-9383-8d334bcd9f97", "name": "network-vif-plugged", "status": "completed", "tag": "68238072-7820-4474-a63e-b28f6e9e9d86"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:35:58 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=9 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:35:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-44e3df66-f471-424f-88aa-5c10a686c5b8 req-4b91ff43-3a0a-4dd9-a8f5-080bcaca2ca9 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:35:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-44e3df66-f471-424f-88aa-5c10a686c5b8 req-4b91ff43-3a0a-4dd9-a8f5-080bcaca2ca9 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:35:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-44e3df66-f471-424f-88aa-5c10a686c5b8 req-4b91ff43-3a0a-4dd9-a8f5-080bcaca2ca9 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:35:58 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=21 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:35:58 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-44e3df66-f471-424f-88aa-5c10a686c5b8 req-4b91ff43-3a0a-4dd9-a8f5-080bcaca2ca9 service nova] Creating event network-vif-plugged:68238072-7820-4474-a63e-b28f6e9e9d86 for instance a8e5dbae-1051-494e-9383-8d334bcd9f97 on user Apr 13 15:35:58 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-44e3df66-f471-424f-88aa-5c10a686c5b8 req-4b91ff43-3a0a-4dd9-a8f5-080bcaca2ca9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039119 Apr 13 15:35:58 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 330/1000] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:35:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:36:13 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:36:13 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:36:13 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:36:13 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f8f53313-7abb-4946-9389-2416d16d887a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:36:13 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-f8f53313-7abb-4946-9389-2416d16d887a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:36:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f8f53313-7abb-4946-9389-2416d16d887a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:36:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f8f53313-7abb-4946-9389-2416d16d887a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:36:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f8f53313-7abb-4946-9389-2416d16d887a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:36:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f8f53313-7abb-4946-9389-2416d16d887a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:36:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f8f53313-7abb-4946-9389-2416d16d887a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:36:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-f8f53313-7abb-4946-9389-2416d16d887a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:36:13 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-f8f53313-7abb-4946-9389-2416d16d887a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] HTTP exception thrown: Instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 could not be found. Apr 13 15:36:13 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f8f53313-7abb-4946-9389-2416d16d887a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Request method failure captured: Apr 13 15:36:13 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/58e8e652-d56c-45b6-92ff-a50406ea48e9 HTTP/1.1 Apr 13 15:36:13 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:36:13 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:36:13 user devstack@n-api.service[61873]: Connection: close Apr 13 15:36:13 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:36:13 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:36:13 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:36:13 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:36:13 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:36:13 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOBurKJYr8ku-a9sArMgKGf_zkPYe813RFy3hL9gqm2lA8nA6HuO5sIKmld2K9ueWSJVv5odFcnKlFc37QtLWXaIxLt9FyBSC8ppfxnpaWtL0HffjHjpcF-R5kmgCDC1i3LhNS5BS_s2X-f1QR1QIvxPG-vNqAgSRbD8S_rxbpklmlLk Apr 13 15:36:13 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:36:13 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:36:13 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:36:13 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:36:13 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:36:13 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:36:13 user devstack@n-api.service[61873]: X-Project-Id: 9154e4239a1a42a3820c27563ba0513f Apr 13 15:36:13 user devstack@n-api.service[61873]: X-Project-Name: tempest-ServerActionsTestJSON-423674903 Apr 13 15:36:13 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:36:13 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:36:13 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:36:13 user devstack@n-api.service[61873]: X-Tenant: tempest-ServerActionsTestJSON-423674903 Apr 13 15:36:13 user devstack@n-api.service[61873]: X-Tenant-Id: 9154e4239a1a42a3820c27563ba0513f Apr 13 15:36:13 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-ServerActionsTestJSON-423674903 Apr 13 15:36:13 user devstack@n-api.service[61873]: X-User: tempest-ServerActionsTestJSON-423674903-project-member Apr 13 15:36:13 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:36:13 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:36:13 user devstack@n-api.service[61873]: X-User-Id: 3c12c62d4137473596571e523163e718 Apr 13 15:36:13 user devstack@n-api.service[61873]: X-User-Name: tempest-ServerActionsTestJSON-423674903-project-member Apr 13 15:36:13 user devstack@n-api.service[61873]: method: > Apr 13 15:36:13 user devstack@n-api.service[61873]: exception: Instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 could not be found. Apr 13 15:36:13 user devstack@n-api.service[61873]: action_args: {'id': '58e8e652-d56c-45b6-92ff-a50406ea48e9'} Apr 13 15:36:13 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 could not be found. Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 could not be found. Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 could not be found. Apr 13 15:36:13 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:36:13 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-f8f53313-7abb-4946-9389-2416d16d887a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Returning 404 to user: Instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:36:13 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-f8f53313-7abb-4946-9389-2416d16d887a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58e8e652-d56c-45b6-92ff-a50406ea48e9" status: 404 len: 111 microversion: 2.1 time: 0.036532 Apr 13 15:36:13 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 336/1001] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:36:13 2023] GET /compute/v2.1/servers/58e8e652-d56c-45b6-92ff-a50406ea48e9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:36:17 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-ef0a8d03-241d-4d39-8de1-80f79eae920c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:36:17 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-ef0a8d03-241d-4d39-8de1-80f79eae920c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:36:17 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=12 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:36:17 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:36:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ef0a8d03-241d-4d39-8de1-80f79eae920c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:36:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ef0a8d03-241d-4d39-8de1-80f79eae920c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:36:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ef0a8d03-241d-4d39-8de1-80f79eae920c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:36:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ef0a8d03-241d-4d39-8de1-80f79eae920c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:36:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ef0a8d03-241d-4d39-8de1-80f79eae920c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:36:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ef0a8d03-241d-4d39-8de1-80f79eae920c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:36:17 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-ef0a8d03-241d-4d39-8de1-80f79eae920c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] HTTP exception thrown: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:36:17 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-ef0a8d03-241d-4d39-8de1-80f79eae920c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Request method failure captured: Apr 13 15:36:17 user devstack@n-api.service[61872]: request: DELETE /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 HTTP/1.1 Apr 13 15:36:17 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:36:17 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:36:17 user devstack@n-api.service[61872]: Connection: close Apr 13 15:36:17 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:36:17 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:36:17 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:36:17 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:36:17 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:36:17 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOBurKJYr8ku-a9sArMgKGf_zkPYe813RFy3hL9gqm2lA8nA6HuO5sIKmld2K9ueWSJVv5odFcnKlFc37QtLWXaIxLt9FyBSC8ppfxnpaWtL0HffjHjpcF-R5kmgCDC1i3LhNS5BS_s2X-f1QR1QIvxPG-vNqAgSRbD8S_rxbpklmlLk Apr 13 15:36:17 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:36:17 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:36:17 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:36:17 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:36:17 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:36:17 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:36:17 user devstack@n-api.service[61872]: X-Project-Id: 9154e4239a1a42a3820c27563ba0513f Apr 13 15:36:17 user devstack@n-api.service[61872]: X-Project-Name: tempest-ServerActionsTestJSON-423674903 Apr 13 15:36:17 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:36:17 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:36:17 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:36:17 user devstack@n-api.service[61872]: X-Tenant: tempest-ServerActionsTestJSON-423674903 Apr 13 15:36:17 user devstack@n-api.service[61872]: X-Tenant-Id: 9154e4239a1a42a3820c27563ba0513f Apr 13 15:36:17 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-ServerActionsTestJSON-423674903 Apr 13 15:36:17 user devstack@n-api.service[61872]: X-User: tempest-ServerActionsTestJSON-423674903-project-member Apr 13 15:36:17 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:36:17 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:36:17 user devstack@n-api.service[61872]: X-User-Id: 3c12c62d4137473596571e523163e718 Apr 13 15:36:17 user devstack@n-api.service[61872]: X-User-Name: tempest-ServerActionsTestJSON-423674903-project-member Apr 13 15:36:17 user devstack@n-api.service[61872]: method: > Apr 13 15:36:17 user devstack@n-api.service[61872]: exception: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:36:17 user devstack@n-api.service[61872]: action_args: {'id': 'ccc7b5bd-5f78-448e-bd82-74b2263dff75'} Apr 13 15:36:17 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:36:17 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:36:17 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-ef0a8d03-241d-4d39-8de1-80f79eae920c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Returning 404 to user: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:36:17 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-ef0a8d03-241d-4d39-8de1-80f79eae920c tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 404 len: 111 microversion: 2.1 time: 0.045271 Apr 13 15:36:17 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 336/1002] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:36:17 2023] DELETE /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:36:17 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:36:17 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:36:17 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-643b4cb2-bf2b-4667-be1d-2c8f1aac990a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:36:17 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-643b4cb2-bf2b-4667-be1d-2c8f1aac990a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:36:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-643b4cb2-bf2b-4667-be1d-2c8f1aac990a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:36:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-643b4cb2-bf2b-4667-be1d-2c8f1aac990a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:36:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-643b4cb2-bf2b-4667-be1d-2c8f1aac990a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:36:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-643b4cb2-bf2b-4667-be1d-2c8f1aac990a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:36:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-643b4cb2-bf2b-4667-be1d-2c8f1aac990a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:36:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-643b4cb2-bf2b-4667-be1d-2c8f1aac990a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:36:18 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-643b4cb2-bf2b-4667-be1d-2c8f1aac990a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] HTTP exception thrown: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:36:18 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-643b4cb2-bf2b-4667-be1d-2c8f1aac990a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Request method failure captured: Apr 13 15:36:18 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 HTTP/1.1 Apr 13 15:36:18 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:36:18 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:36:18 user devstack@n-api.service[61871]: Connection: close Apr 13 15:36:18 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:36:18 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:36:18 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:36:18 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:36:18 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:36:18 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOBurKJYr8ku-a9sArMgKGf_zkPYe813RFy3hL9gqm2lA8nA6HuO5sIKmld2K9ueWSJVv5odFcnKlFc37QtLWXaIxLt9FyBSC8ppfxnpaWtL0HffjHjpcF-R5kmgCDC1i3LhNS5BS_s2X-f1QR1QIvxPG-vNqAgSRbD8S_rxbpklmlLk Apr 13 15:36:18 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:36:18 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:36:18 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:36:18 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:36:18 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:36:18 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:36:18 user devstack@n-api.service[61871]: X-Project-Id: 9154e4239a1a42a3820c27563ba0513f Apr 13 15:36:18 user devstack@n-api.service[61871]: X-Project-Name: tempest-ServerActionsTestJSON-423674903 Apr 13 15:36:18 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:36:18 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:36:18 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9154e4239a1a42a3820c27563ba0513f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:36:18 user devstack@n-api.service[61871]: X-Tenant: tempest-ServerActionsTestJSON-423674903 Apr 13 15:36:18 user devstack@n-api.service[61871]: X-Tenant-Id: 9154e4239a1a42a3820c27563ba0513f Apr 13 15:36:18 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-ServerActionsTestJSON-423674903 Apr 13 15:36:18 user devstack@n-api.service[61871]: X-User: tempest-ServerActionsTestJSON-423674903-project-member Apr 13 15:36:18 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:36:18 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:36:18 user devstack@n-api.service[61871]: X-User-Id: 3c12c62d4137473596571e523163e718 Apr 13 15:36:18 user devstack@n-api.service[61871]: X-User-Name: tempest-ServerActionsTestJSON-423674903-project-member Apr 13 15:36:18 user devstack@n-api.service[61871]: method: > Apr 13 15:36:18 user devstack@n-api.service[61871]: exception: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:36:18 user devstack@n-api.service[61871]: action_args: {'id': 'ccc7b5bd-5f78-448e-bd82-74b2263dff75'} Apr 13 15:36:18 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. Apr 13 15:36:18 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:36:18 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-643b4cb2-bf2b-4667-be1d-2c8f1aac990a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Returning 404 to user: Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:36:18 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-643b4cb2-bf2b-4667-be1d-2c8f1aac990a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75" status: 404 len: 111 microversion: 2.1 time: 0.039249 Apr 13 15:36:18 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 331/1003] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:36:17 2023] GET /compute/v2.1/servers/ccc7b5bd-5f78-448e-bd82-74b2263dff75 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:36:18 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-0490b030-7bf5-45c0-a701-c887e8f782eb tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Calling method '.version_select at 0x7f3a8bd4eef0>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:36:18 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-0490b030-7bf5-45c0-a701-c887e8f782eb tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-164816521" status: 202 len: 0 microversion: 2.1 time: 0.028355 Apr 13 15:36:18 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 337/1004] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 15:36:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-164816521 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:36:24 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-a9de4f03-2055-4149-ba13-7783741d410d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:36:24 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-a9de4f03-2055-4149-ba13-7783741d410d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:36:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a9de4f03-2055-4149-ba13-7783741d410d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:36:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a9de4f03-2055-4149-ba13-7783741d410d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:36:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a9de4f03-2055-4149-ba13-7783741d410d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:36:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a9de4f03-2055-4149-ba13-7783741d410d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:36:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a9de4f03-2055-4149-ba13-7783741d410d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:36:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-a9de4f03-2055-4149-ba13-7783741d410d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:36:25 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-a9de4f03-2055-4149-ba13-7783741d410d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:36:25 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-a9de4f03-2055-4149-ba13-7783741d410d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:36:25 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-a9de4f03-2055-4149-ba13-7783741d410d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:36:25 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-a9de4f03-2055-4149-ba13-7783741d410d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380" status: 200 len: 1588 microversion: 2.20 time: 0.168796 Apr 13 15:36:25 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 337/1005] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:36:24 2023] GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380 => generated 1588 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:36:32 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-7a554eb6-5405-4e09-9402-7d450da79093 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:36:32 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-7a554eb6-5405-4e09-9402-7d450da79093 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:36:32 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:36:32 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:36:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7a554eb6-5405-4e09-9402-7d450da79093 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:36:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7a554eb6-5405-4e09-9402-7d450da79093 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:36:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7a554eb6-5405-4e09-9402-7d450da79093 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:36:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7a554eb6-5405-4e09-9402-7d450da79093 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:36:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7a554eb6-5405-4e09-9402-7d450da79093 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:36:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7a554eb6-5405-4e09-9402-7d450da79093 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:36:32 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-7a554eb6-5405-4e09-9402-7d450da79093 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:36:32 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-7a554eb6-5405-4e09-9402-7d450da79093 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8e5dbae-1051-494e-9383-8d334bcd9f97" status: 200 len: 1551 microversion: 2.1 time: 0.621703 Apr 13 15:36:32 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 332/1006] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:36:32 2023] GET /compute/v2.1/servers/a8e5dbae-1051-494e-9383-8d334bcd9f97 => generated 1551 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:36:37 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:36:37 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:36:37 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-d919ebfa-adca-4a2c-aacf-55b6532796a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:36:37 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-d919ebfa-adca-4a2c-aacf-55b6532796a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:36:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d919ebfa-adca-4a2c-aacf-55b6532796a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:36:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d919ebfa-adca-4a2c-aacf-55b6532796a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:36:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d919ebfa-adca-4a2c-aacf-55b6532796a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:36:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d919ebfa-adca-4a2c-aacf-55b6532796a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:36:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d919ebfa-adca-4a2c-aacf-55b6532796a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:36:37 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d919ebfa-adca-4a2c-aacf-55b6532796a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:36:37 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-d919ebfa-adca-4a2c-aacf-55b6532796a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300cbdea17c74a418f50e2d581691ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a40f5a9b5e4f3fb8467b6ea304bbe5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:36:37 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-d919ebfa-adca-4a2c-aacf-55b6532796a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" status: 200 len: 1496 microversion: 2.1 time: 0.181995 Apr 13 15:36:37 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 338/1007] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:36:37 2023] GET /compute/v2.1/servers/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd => generated 1496 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:37:16 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=4 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:37:16 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=8 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:37:16 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-c6de8c2e-9f8c-4fca-9371-b0aa29400d1f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Action: 'create', calling method: .version_select at 0x7f3a8fdb30a0>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1169680877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1KlcmjH08ASB6EGqoWCNiRIccnybruptZ8sbR1PLZTq358S36cyJUgy4qa0Lb0HyrKahfHVxBpwpLbc5x22ZY4G+mKj9Fadjm1HmD3fWxrE1krMESQzmxfti/1t4bU2w=="}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:37:16 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-c6de8c2e-9f8c-4fca-9371-b0aa29400d1f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Getting quotas for project 3fc833ca51a84b6789f0def7357d4c59. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:37:16 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-c6de8c2e-9f8c-4fca-9371-b0aa29400d1f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Getting quotas for user af0f7d9513b44bda8e53597cf7751ec0 and project 3fc833ca51a84b6789f0def7357d4c59. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:37:17 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-c6de8c2e-9f8c-4fca-9371-b0aa29400d1f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.264795 Apr 13 15:37:17 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 338/1008] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 15:37:16 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:37:18 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1899978738", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1169680877", "security_groups": [{"name": "tempest-secgroup-smoke-1957741697"}], "networks": [{"uuid": "1f6973b5-16ba-4e7b-ac56-dff73d570d12"}]}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:37:18 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:37:18 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:37:18 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] validate_networks() for [('1f6973b5-16ba-4e7b-ac56-dff73d570d12', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:37:18 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:37:18 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:37:18 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:37:18 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:37:18 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:37:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:18 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:18 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Getting quotas for project 3fc833ca51a84b6789f0def7357d4c59. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:37:18 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Getting quotas for user af0f7d9513b44bda8e53597cf7751ec0 and project 3fc833ca51a84b6789f0def7357d4c59. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:37:18 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:37:18 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:37:18 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.598765 Apr 13 15:37:18 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 333/1009] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:37:18 2023] POST /compute/v2.1/servers => generated 404 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:37:18 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-621a635f-d2c4-4868-90e5-a63fc5b12c96 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:37:18 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-621a635f-d2c4-4868-90e5-a63fc5b12c96 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:37:18 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:37:18 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:37:18 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-621a635f-d2c4-4868-90e5-a63fc5b12c96 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0f7d9513b44bda8e53597cf7751ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc833ca51a84b6789f0def7357d4c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:37:19 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-621a635f-d2c4-4868-90e5-a63fc5b12c96 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37" status: 200 len: 1257 microversion: 2.1 time: 0.071894 Apr 13 15:37:19 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 339/1010] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:37:18 2023] GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37 => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:37:21 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-3bac8bfb-3855-4f08-a4c6-256bf4642e09 req-1876da56-c5db-479d-9871-fbe6ba25b778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dccdbfbe-1261-490e-b8bf-b06e46d42f37", "tag": "bee671f2-48c8-41d0-945c-3c8b796aa286"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:37:21 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3bac8bfb-3855-4f08-a4c6-256bf4642e09 req-1876da56-c5db-479d-9871-fbe6ba25b778 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:21 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3bac8bfb-3855-4f08-a4c6-256bf4642e09 req-1876da56-c5db-479d-9871-fbe6ba25b778 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:21 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3bac8bfb-3855-4f08-a4c6-256bf4642e09 req-1876da56-c5db-479d-9871-fbe6ba25b778 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:21 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-3bac8bfb-3855-4f08-a4c6-256bf4642e09 req-1876da56-c5db-479d-9871-fbe6ba25b778 service nova] Creating event network-changed:bee671f2-48c8-41d0-945c-3c8b796aa286 for instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 on user Apr 13 15:37:21 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-3bac8bfb-3855-4f08-a4c6-256bf4642e09 req-1876da56-c5db-479d-9871-fbe6ba25b778 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033444 Apr 13 15:37:22 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 339/1011] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:37:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:37:24 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-691a86e1-8fbd-495d-8249-b99981ab3e16 req-9115c417-9304-4daf-8b09-2c73b83d1cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dccdbfbe-1261-490e-b8bf-b06e46d42f37", "name": "network-vif-plugged", "status": "completed", "tag": "bee671f2-48c8-41d0-945c-3c8b796aa286"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:37:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-691a86e1-8fbd-495d-8249-b99981ab3e16 req-9115c417-9304-4daf-8b09-2c73b83d1cc0 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-691a86e1-8fbd-495d-8249-b99981ab3e16 req-9115c417-9304-4daf-8b09-2c73b83d1cc0 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:24 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-691a86e1-8fbd-495d-8249-b99981ab3e16 req-9115c417-9304-4daf-8b09-2c73b83d1cc0 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:24 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-691a86e1-8fbd-495d-8249-b99981ab3e16 req-9115c417-9304-4daf-8b09-2c73b83d1cc0 service nova] Creating event network-vif-plugged:bee671f2-48c8-41d0-945c-3c8b796aa286 for instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 on user Apr 13 15:37:24 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-691a86e1-8fbd-495d-8249-b99981ab3e16 req-9115c417-9304-4daf-8b09-2c73b83d1cc0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032727 Apr 13 15:37:24 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 334/1012] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:37:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:37:25 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-9f49b56c-34bf-4a21-83fa-5c87fcd3be24 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:37:25 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-9f49b56c-34bf-4a21-83fa-5c87fcd3be24 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:37:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9f49b56c-34bf-4a21-83fa-5c87fcd3be24 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9f49b56c-34bf-4a21-83fa-5c87fcd3be24 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9f49b56c-34bf-4a21-83fa-5c87fcd3be24 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9f49b56c-34bf-4a21-83fa-5c87fcd3be24 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9f49b56c-34bf-4a21-83fa-5c87fcd3be24 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-9f49b56c-34bf-4a21-83fa-5c87fcd3be24 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:25 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-9f49b56c-34bf-4a21-83fa-5c87fcd3be24 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.088331 Apr 13 15:37:25 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 340/1013] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 15:37:25 2023] GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380/os-interface => generated 283 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:37:26 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dccdbfbe-1261-490e-b8bf-b06e46d42f37", "name": "network-vif-plugged", "status": "completed", "tag": "bee671f2-48c8-41d0-945c-3c8b796aa286"}, {"name": "network-changed", "server_uuid": "32b179d3-712f-47bc-94ad-387c8ca77380", "tag": "1cb2ae52-e4fa-4627-b3f3-301af5732358"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:37:26 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-26c74c99-98f0-405f-968a-e5c8fcb40f45 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:37:26 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-26c74c99-98f0-405f-968a-e5c8fcb40f45 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:37:26 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-26c74c99-98f0-405f-968a-e5c8fcb40f45 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:26 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-26c74c99-98f0-405f-968a-e5c8fcb40f45 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:26 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-26c74c99-98f0-405f-968a-e5c8fcb40f45 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:26 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-26c74c99-98f0-405f-968a-e5c8fcb40f45 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:26 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-26c74c99-98f0-405f-968a-e5c8fcb40f45 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:26 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-26c74c99-98f0-405f-968a-e5c8fcb40f45 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:26 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:26 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-26c74c99-98f0-405f-968a-e5c8fcb40f45 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380/ips" status: 200 len: 111 microversion: 2.20 time: 0.039707 Apr 13 15:37:26 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 335/1014] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 13 15:37:26 2023] GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380/ips => generated 111 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:37:26 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] Creating event network-vif-plugged:bee671f2-48c8-41d0-945c-3c8b796aa286 for instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 on user Apr 13 15:37:26 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] Creating event network-changed:1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance 32b179d3-712f-47bc-94ad-387c8ca77380 on user Apr 13 15:37:26 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.056436 Apr 13 15:37:26 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 340/1015] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:37:26 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:37:28 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:37:28 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:37:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:28 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:28 user devstack@n-api.service[61873]: DEBUG nova.objects.instance [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'flavor' on Instance uuid 32b179d3-712f-47bc-94ad-387c8ca77380 {{(pid=61873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:37:29 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:37:29 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "POST /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380/action" status: 202 len: 0 microversion: 2.20 time: 0.889206 Apr 13 15:37:29 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 341/1016] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 15:37:28 2023] POST /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380/action => generated 0 bytes in 891 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:37:29 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-c4043e47-98bd-4c15-87bf-8d56cfa51bad tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:37:29 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-c4043e47-98bd-4c15-87bf-8d56cfa51bad tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:37:29 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:37:29 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:37:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c4043e47-98bd-4c15-87bf-8d56cfa51bad tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c4043e47-98bd-4c15-87bf-8d56cfa51bad tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c4043e47-98bd-4c15-87bf-8d56cfa51bad tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c4043e47-98bd-4c15-87bf-8d56cfa51bad tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c4043e47-98bd-4c15-87bf-8d56cfa51bad tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-c4043e47-98bd-4c15-87bf-8d56cfa51bad tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:29 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-c4043e47-98bd-4c15-87bf-8d56cfa51bad tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:37:29 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-c4043e47-98bd-4c15-87bf-8d56cfa51bad tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:37:29 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-c4043e47-98bd-4c15-87bf-8d56cfa51bad tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:37:29 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-c4043e47-98bd-4c15-87bf-8d56cfa51bad tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380" status: 200 len: 1712 microversion: 2.20 time: 0.343972 Apr 13 15:37:29 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 336/1017] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:37:29 2023] GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380 => generated 1712 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:37:29 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=4 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:37:29 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-6365a50a-4562-475a-ae6d-7e77f7d8c7c7 req-7b8c919c-6198-4842-88e7-92a623aa8789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b179d3-712f-47bc-94ad-387c8ca77380", "name": "network-vif-unplugged", "status": "completed", "tag": "1cb2ae52-e4fa-4627-b3f3-301af5732358"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:37:29 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-6365a50a-4562-475a-ae6d-7e77f7d8c7c7 req-7b8c919c-6198-4842-88e7-92a623aa8789 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:29 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-6365a50a-4562-475a-ae6d-7e77f7d8c7c7 req-7b8c919c-6198-4842-88e7-92a623aa8789 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:29 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-6365a50a-4562-475a-ae6d-7e77f7d8c7c7 req-7b8c919c-6198-4842-88e7-92a623aa8789 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:29 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-6365a50a-4562-475a-ae6d-7e77f7d8c7c7 req-7b8c919c-6198-4842-88e7-92a623aa8789 service nova] Creating event network-vif-unplugged:1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance 32b179d3-712f-47bc-94ad-387c8ca77380 on user Apr 13 15:37:30 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-6365a50a-4562-475a-ae6d-7e77f7d8c7c7 req-7b8c919c-6198-4842-88e7-92a623aa8789 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040654 Apr 13 15:37:30 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 341/1018] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:37:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:37:32 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-5d0985f5-1171-4341-9bb0-494b69790c94 req-28f9af2c-959c-4569-b6fa-b6d742f5109f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b179d3-712f-47bc-94ad-387c8ca77380", "name": "network-vif-plugged", "status": "completed", "tag": "1cb2ae52-e4fa-4627-b3f3-301af5732358"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:37:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5d0985f5-1171-4341-9bb0-494b69790c94 req-28f9af2c-959c-4569-b6fa-b6d742f5109f service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5d0985f5-1171-4341-9bb0-494b69790c94 req-28f9af2c-959c-4569-b6fa-b6d742f5109f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:32 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5d0985f5-1171-4341-9bb0-494b69790c94 req-28f9af2c-959c-4569-b6fa-b6d742f5109f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:32 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-5d0985f5-1171-4341-9bb0-494b69790c94 req-28f9af2c-959c-4569-b6fa-b6d742f5109f service nova] Creating event network-vif-plugged:1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance 32b179d3-712f-47bc-94ad-387c8ca77380 on user Apr 13 15:37:32 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-5d0985f5-1171-4341-9bb0-494b69790c94 req-28f9af2c-959c-4569-b6fa-b6d742f5109f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042742 Apr 13 15:37:32 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 342/1019] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:37:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:37:32 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-a2287d0a-267e-44b9-8ad8-bab732cfecd5 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:37:32 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-a2287d0a-267e-44b9-8ad8-bab732cfecd5 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:37:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a2287d0a-267e-44b9-8ad8-bab732cfecd5 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a2287d0a-267e-44b9-8ad8-bab732cfecd5 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a2287d0a-267e-44b9-8ad8-bab732cfecd5 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a2287d0a-267e-44b9-8ad8-bab732cfecd5 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a2287d0a-267e-44b9-8ad8-bab732cfecd5 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:32 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a2287d0a-267e-44b9-8ad8-bab732cfecd5 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:33 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-a2287d0a-267e-44b9-8ad8-bab732cfecd5 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:37:33 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-a2287d0a-267e-44b9-8ad8-bab732cfecd5 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8e5dbae-1051-494e-9383-8d334bcd9f97" status: 200 len: 1551 microversion: 2.1 time: 0.196481 Apr 13 15:37:33 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 337/1020] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:37:32 2023] GET /compute/v2.1/servers/a8e5dbae-1051-494e-9383-8d334bcd9f97 => generated 1551 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:37:33 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:37:33 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:37:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:33 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Going to try to terminate instance {{(pid=61872) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:37:33 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a8e5dbae-1051-494e-9383-8d334bcd9f97" status: 204 len: 0 microversion: 2.1 time: 0.122958 Apr 13 15:37:33 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 342/1021] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:37:33 2023] DELETE /compute/v2.1/servers/a8e5dbae-1051-494e-9383-8d334bcd9f97 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:37:33 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-bb197149-0524-45a4-bc4e-41f603d7e444 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:37:33 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-bb197149-0524-45a4-bc4e-41f603d7e444 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:37:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-bb197149-0524-45a4-bc4e-41f603d7e444 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-bb197149-0524-45a4-bc4e-41f603d7e444 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-bb197149-0524-45a4-bc4e-41f603d7e444 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-bb197149-0524-45a4-bc4e-41f603d7e444 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-bb197149-0524-45a4-bc4e-41f603d7e444 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-bb197149-0524-45a4-bc4e-41f603d7e444 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:33 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-bb197149-0524-45a4-bc4e-41f603d7e444 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:37:33 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-bb197149-0524-45a4-bc4e-41f603d7e444 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8e5dbae-1051-494e-9383-8d334bcd9f97" status: 200 len: 1557 microversion: 2.1 time: 0.221349 Apr 13 15:37:33 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 343/1022] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:37:33 2023] GET /compute/v2.1/servers/a8e5dbae-1051-494e-9383-8d334bcd9f97 => generated 1557 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 15:37:33 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-ffd25483-b83d-4223-a4b6-ed51d62eccda req-c3c83c13-c17e-4658-b5da-db08963f18e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8e5dbae-1051-494e-9383-8d334bcd9f97", "name": "network-vif-unplugged", "status": "completed", "tag": "68238072-7820-4474-a63e-b28f6e9e9d86"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:37:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ffd25483-b83d-4223-a4b6-ed51d62eccda req-c3c83c13-c17e-4658-b5da-db08963f18e3 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ffd25483-b83d-4223-a4b6-ed51d62eccda req-c3c83c13-c17e-4658-b5da-db08963f18e3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ffd25483-b83d-4223-a4b6-ed51d62eccda req-c3c83c13-c17e-4658-b5da-db08963f18e3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:33 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-ffd25483-b83d-4223-a4b6-ed51d62eccda req-c3c83c13-c17e-4658-b5da-db08963f18e3 service nova] Creating event network-vif-unplugged:68238072-7820-4474-a63e-b28f6e9e9d86 for instance a8e5dbae-1051-494e-9383-8d334bcd9f97 on user Apr 13 15:37:33 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-ffd25483-b83d-4223-a4b6-ed51d62eccda req-c3c83c13-c17e-4658-b5da-db08963f18e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034997 Apr 13 15:37:33 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 338/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:37:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:37:35 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-4b92833a-fb0c-4147-acfe-b45d558e2b2c req-9c403d62-760b-4c1e-9146-0e920f23e66d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b179d3-712f-47bc-94ad-387c8ca77380", "tag": "1cb2ae52-e4fa-4627-b3f3-301af5732358"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:37:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-4b92833a-fb0c-4147-acfe-b45d558e2b2c req-9c403d62-760b-4c1e-9146-0e920f23e66d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-4b92833a-fb0c-4147-acfe-b45d558e2b2c req-9c403d62-760b-4c1e-9146-0e920f23e66d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-4b92833a-fb0c-4147-acfe-b45d558e2b2c req-9c403d62-760b-4c1e-9146-0e920f23e66d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:35 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-4b92833a-fb0c-4147-acfe-b45d558e2b2c req-9c403d62-760b-4c1e-9146-0e920f23e66d service nova] Creating event network-changed:1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance 32b179d3-712f-47bc-94ad-387c8ca77380 on user Apr 13 15:37:35 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-4b92833a-fb0c-4147-acfe-b45d558e2b2c req-9c403d62-760b-4c1e-9146-0e920f23e66d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029053 Apr 13 15:37:35 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 343/1024] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:37:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:37:35 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-0fd8df23-cb3b-465b-a06e-512d1e44866f req-78134d31-cd43-4323-a8bc-662be24dbec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8e5dbae-1051-494e-9383-8d334bcd9f97", "name": "network-vif-plugged", "status": "completed", "tag": "68238072-7820-4474-a63e-b28f6e9e9d86"}, {"server_uuid": "a8e5dbae-1051-494e-9383-8d334bcd9f97", "name": "network-vif-deleted", "tag": "68238072-7820-4474-a63e-b28f6e9e9d86"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:37:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-0fd8df23-cb3b-465b-a06e-512d1e44866f req-78134d31-cd43-4323-a8bc-662be24dbec9 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-0fd8df23-cb3b-465b-a06e-512d1e44866f req-78134d31-cd43-4323-a8bc-662be24dbec9 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:35 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-0fd8df23-cb3b-465b-a06e-512d1e44866f req-78134d31-cd43-4323-a8bc-662be24dbec9 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:35 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-0fd8df23-cb3b-465b-a06e-512d1e44866f req-78134d31-cd43-4323-a8bc-662be24dbec9 service nova] Creating event network-vif-plugged:68238072-7820-4474-a63e-b28f6e9e9d86 for instance a8e5dbae-1051-494e-9383-8d334bcd9f97 on user Apr 13 15:37:35 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-0fd8df23-cb3b-465b-a06e-512d1e44866f req-78134d31-cd43-4323-a8bc-662be24dbec9 service nova] Creating event network-vif-deleted:68238072-7820-4474-a63e-b28f6e9e9d86 for instance a8e5dbae-1051-494e-9383-8d334bcd9f97 on user Apr 13 15:37:35 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-0fd8df23-cb3b-465b-a06e-512d1e44866f req-78134d31-cd43-4323-a8bc-662be24dbec9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033748 Apr 13 15:37:35 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 344/1025] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:37:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:37:37 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea", "device": "/dev/vdb"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:37:37 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:37:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:37 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:37 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292565 Apr 13 15:37:37 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 339/1026] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:37:37 2023] POST /compute/v2.1/servers/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:37:59 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:37:59 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:37:59 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:37:59 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:37:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:59 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:59 user devstack@n-api.service[61872]: DEBUG nova.objects.instance [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lazy-loading 'services' on Instance uuid b2ed660b-7c9a-4a67-a48c-9bbbacc046bd {{(pid=61872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:37:59 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/os-volume_attachments/8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea" status: 202 len: 0 microversion: 2.1 time: 0.170655 Apr 13 15:37:59 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 344/1027] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:37:59 2023] DELETE /compute/v2.1/servers/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/os-volume_attachments/8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:37:59 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=14 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:37:59 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:37:59 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:37:59 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:37:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:37:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:37:59 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:37:59 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Going to try to terminate instance {{(pid=61873) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:37:59 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" status: 204 len: 0 microversion: 2.1 time: 0.187590 Apr 13 15:37:59 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 345/1028] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:37:59 2023] DELETE /compute/v2.1/servers/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:37:59 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-4fa1dce6-b99a-445b-8d61-4b76be1cc383 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:38:00 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-4fa1dce6-b99a-445b-8d61-4b76be1cc383 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:38:00 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:38:00 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:38:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4fa1dce6-b99a-445b-8d61-4b76be1cc383 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:38:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4fa1dce6-b99a-445b-8d61-4b76be1cc383 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:38:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4fa1dce6-b99a-445b-8d61-4b76be1cc383 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:38:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4fa1dce6-b99a-445b-8d61-4b76be1cc383 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:38:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4fa1dce6-b99a-445b-8d61-4b76be1cc383 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:38:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-4fa1dce6-b99a-445b-8d61-4b76be1cc383 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:38:00 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-4fa1dce6-b99a-445b-8d61-4b76be1cc383 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300cbdea17c74a418f50e2d581691ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a40f5a9b5e4f3fb8467b6ea304bbe5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:38:00 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-4fa1dce6-b99a-445b-8d61-4b76be1cc383 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" status: 200 len: 1548 microversion: 2.1 time: 0.168319 Apr 13 15:38:00 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 340/1029] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:37:59 2023] GET /compute/v2.1/servers/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 15:38:01 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-3739d9b4-ef08-4588-a109-bf0bed693f69 req-ff692c7c-fa38-4015-a918-b883dd03d339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd", "name": "network-vif-unplugged", "status": "completed", "tag": "d9dc5c9c-85d3-406a-be61-8f3cc9354712"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:38:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3739d9b4-ef08-4588-a109-bf0bed693f69 req-ff692c7c-fa38-4015-a918-b883dd03d339 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:38:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3739d9b4-ef08-4588-a109-bf0bed693f69 req-ff692c7c-fa38-4015-a918-b883dd03d339 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:38:01 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-3739d9b4-ef08-4588-a109-bf0bed693f69 req-ff692c7c-fa38-4015-a918-b883dd03d339 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:38:01 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-3739d9b4-ef08-4588-a109-bf0bed693f69 req-ff692c7c-fa38-4015-a918-b883dd03d339 service nova] Creating event network-vif-unplugged:d9dc5c9c-85d3-406a-be61-8f3cc9354712 for instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd on user Apr 13 15:38:01 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-3739d9b4-ef08-4588-a109-bf0bed693f69 req-ff692c7c-fa38-4015-a918-b883dd03d339 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027599 Apr 13 15:38:01 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 345/1030] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:38:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:38:02 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-a73b0dd6-4508-4840-81a1-a63d3913f0aa req-9d5122cd-7291-4741-b7b2-5628369626cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd", "name": "network-vif-deleted", "tag": "d9dc5c9c-85d3-406a-be61-8f3cc9354712"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:38:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-a73b0dd6-4508-4840-81a1-a63d3913f0aa req-9d5122cd-7291-4741-b7b2-5628369626cc service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:38:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-a73b0dd6-4508-4840-81a1-a63d3913f0aa req-9d5122cd-7291-4741-b7b2-5628369626cc service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:38:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-a73b0dd6-4508-4840-81a1-a63d3913f0aa req-9d5122cd-7291-4741-b7b2-5628369626cc service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:38:02 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-a73b0dd6-4508-4840-81a1-a63d3913f0aa req-9d5122cd-7291-4741-b7b2-5628369626cc service nova] Creating event network-vif-deleted:d9dc5c9c-85d3-406a-be61-8f3cc9354712 for instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd on user Apr 13 15:38:02 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-a73b0dd6-4508-4840-81a1-a63d3913f0aa req-9d5122cd-7291-4741-b7b2-5628369626cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034487 Apr 13 15:38:02 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 346/1031] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:38:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:38:03 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-47c5685f-434e-4e9b-b2e3-7a6304e8a6d8 req-f1904a8a-8789-4f70-ab83-b34d9b2a3e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd", "name": "network-vif-plugged", "status": "completed", "tag": "d9dc5c9c-85d3-406a-be61-8f3cc9354712"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:38:03 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-47c5685f-434e-4e9b-b2e3-7a6304e8a6d8 req-f1904a8a-8789-4f70-ab83-b34d9b2a3e3b service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:38:03 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-47c5685f-434e-4e9b-b2e3-7a6304e8a6d8 req-f1904a8a-8789-4f70-ab83-b34d9b2a3e3b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:38:03 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-47c5685f-434e-4e9b-b2e3-7a6304e8a6d8 req-f1904a8a-8789-4f70-ab83-b34d9b2a3e3b service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:38:03 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-47c5685f-434e-4e9b-b2e3-7a6304e8a6d8 req-f1904a8a-8789-4f70-ab83-b34d9b2a3e3b service nova] Creating event network-vif-plugged:d9dc5c9c-85d3-406a-be61-8f3cc9354712 for instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd on user Apr 13 15:38:03 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-47c5685f-434e-4e9b-b2e3-7a6304e8a6d8 req-f1904a8a-8789-4f70-ab83-b34d9b2a3e3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028140 Apr 13 15:38:03 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 341/1032] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:38:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:38:09 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-de3d1f4f-14da-4227-9883-6ee7baebe780 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:38:09 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-de3d1f4f-14da-4227-9883-6ee7baebe780 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:38:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-de3d1f4f-14da-4227-9883-6ee7baebe780 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:38:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-de3d1f4f-14da-4227-9883-6ee7baebe780 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:38:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-de3d1f4f-14da-4227-9883-6ee7baebe780 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:38:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-de3d1f4f-14da-4227-9883-6ee7baebe780 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:38:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-de3d1f4f-14da-4227-9883-6ee7baebe780 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:38:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-de3d1f4f-14da-4227-9883-6ee7baebe780 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:38:09 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-de3d1f4f-14da-4227-9883-6ee7baebe780 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0f7d9513b44bda8e53597cf7751ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc833ca51a84b6789f0def7357d4c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:38:09 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-de3d1f4f-14da-4227-9883-6ee7baebe780 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37" status: 200 len: 1569 microversion: 2.1 time: 0.287349 Apr 13 15:38:09 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 346/1033] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:38:09 2023] GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37 => generated 1569 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:38:19 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:38:19 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:38:19 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-55e541cd-e5e8-4195-8e1b-18e37d9ec6f1 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:38:19 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-55e541cd-e5e8-4195-8e1b-18e37d9ec6f1 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:38:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-55e541cd-e5e8-4195-8e1b-18e37d9ec6f1 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:38:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-55e541cd-e5e8-4195-8e1b-18e37d9ec6f1 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:38:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-55e541cd-e5e8-4195-8e1b-18e37d9ec6f1 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:38:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-55e541cd-e5e8-4195-8e1b-18e37d9ec6f1 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:38:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-55e541cd-e5e8-4195-8e1b-18e37d9ec6f1 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:38:19 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-55e541cd-e5e8-4195-8e1b-18e37d9ec6f1 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:38:20 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-55e541cd-e5e8-4195-8e1b-18e37d9ec6f1 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:38:20 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-55e541cd-e5e8-4195-8e1b-18e37d9ec6f1 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:38:20 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-55e541cd-e5e8-4195-8e1b-18e37d9ec6f1 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:38:20 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-55e541cd-e5e8-4195-8e1b-18e37d9ec6f1 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380" status: 200 len: 1653 microversion: 2.20 time: 0.215383 Apr 13 15:38:20 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 347/1034] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:38:19 2023] GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380 => generated 1653 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:38:23 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=4 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:38:23 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=8 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:38:23 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-fb0eaf23-431f-4150-8ca2-13257af0f5ec tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:38:23 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-fb0eaf23-431f-4150-8ca2-13257af0f5ec tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:38:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fb0eaf23-431f-4150-8ca2-13257af0f5ec tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:38:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fb0eaf23-431f-4150-8ca2-13257af0f5ec tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:38:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fb0eaf23-431f-4150-8ca2-13257af0f5ec tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:38:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fb0eaf23-431f-4150-8ca2-13257af0f5ec tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:38:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fb0eaf23-431f-4150-8ca2-13257af0f5ec tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:38:23 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fb0eaf23-431f-4150-8ca2-13257af0f5ec tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:38:23 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-fb0eaf23-431f-4150-8ca2-13257af0f5ec tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HTTP exception thrown: Instance a8e5dbae-1051-494e-9383-8d334bcd9f97 could not be found. Apr 13 15:38:23 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-fb0eaf23-431f-4150-8ca2-13257af0f5ec tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Request method failure captured: Apr 13 15:38:23 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/a8e5dbae-1051-494e-9383-8d334bcd9f97 HTTP/1.1 Apr 13 15:38:23 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:38:23 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:38:23 user devstack@n-api.service[61871]: Connection: close Apr 13 15:38:23 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:38:23 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:38:23 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:38:23 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:38:23 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:38:23 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOCAkop2IkGDfTg_hLFhCzVF0r-Snnfp8mpD-rNTz3fSyNRaGCKUvuIX-bvQSQt24XSPbyAQXj1tiZH1C9TwK7awcWO7BHnx8xBG9YOZB63Dpng-DDIXtPRCA4OT9QRrpOESCL1mwTOYQNnj8ZeocbvX0wE2u-g1UjUjvIIUGz4v71K0 Apr 13 15:38:23 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:38:23 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:38:23 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:38:23 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:38:23 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:38:23 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:38:23 user devstack@n-api.service[61871]: X-Project-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:38:23 user devstack@n-api.service[61871]: X-Project-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:38:23 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:38:23 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:38:23 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:38:23 user devstack@n-api.service[61871]: X-Tenant: tempest-TestVolumeBootPattern-374778702 Apr 13 15:38:23 user devstack@n-api.service[61871]: X-Tenant-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:38:23 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:38:23 user devstack@n-api.service[61871]: X-User: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:38:23 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:38:23 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:38:23 user devstack@n-api.service[61871]: X-User-Id: 0307fb8d127a41079e34355904352231 Apr 13 15:38:23 user devstack@n-api.service[61871]: X-User-Name: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:38:23 user devstack@n-api.service[61871]: method: > Apr 13 15:38:23 user devstack@n-api.service[61871]: exception: Instance a8e5dbae-1051-494e-9383-8d334bcd9f97 could not be found. Apr 13 15:38:23 user devstack@n-api.service[61871]: action_args: {'id': 'a8e5dbae-1051-494e-9383-8d334bcd9f97'} Apr 13 15:38:23 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8e5dbae-1051-494e-9383-8d334bcd9f97 could not be found. Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8e5dbae-1051-494e-9383-8d334bcd9f97 could not be found. Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8e5dbae-1051-494e-9383-8d334bcd9f97 could not be found. Apr 13 15:38:23 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:38:23 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-fb0eaf23-431f-4150-8ca2-13257af0f5ec tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Returning 404 to user: Instance a8e5dbae-1051-494e-9383-8d334bcd9f97 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:38:23 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-fb0eaf23-431f-4150-8ca2-13257af0f5ec tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8e5dbae-1051-494e-9383-8d334bcd9f97" status: 404 len: 111 microversion: 2.1 time: 0.032315 Apr 13 15:38:23 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 342/1035] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:38:23 2023] GET /compute/v2.1/servers/a8e5dbae-1051-494e-9383-8d334bcd9f97 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:38:25 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:38:25 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:38:25 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:38:25 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:38:25 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:38:25 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:38:25 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:38:25 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:38:25 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:38:25 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:38:25 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Going to try to terminate instance {{(pid=61872) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:38:25 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227" status: 204 len: 0 microversion: 2.1 time: 0.125214 Apr 13 15:38:25 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 347/1036] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:38:25 2023] DELETE /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:38:25 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-652b8a79-d959-419a-a90b-bc3b920b759d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:38:25 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-652b8a79-d959-419a-a90b-bc3b920b759d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:38:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-652b8a79-d959-419a-a90b-bc3b920b759d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:38:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-652b8a79-d959-419a-a90b-bc3b920b759d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:38:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-652b8a79-d959-419a-a90b-bc3b920b759d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:38:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-652b8a79-d959-419a-a90b-bc3b920b759d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:38:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-652b8a79-d959-419a-a90b-bc3b920b759d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:38:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-652b8a79-d959-419a-a90b-bc3b920b759d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:38:26 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-652b8a79-d959-419a-a90b-bc3b920b759d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:38:26 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-652b8a79-d959-419a-a90b-bc3b920b759d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227" status: 200 len: 1399 microversion: 2.1 time: 0.930568 Apr 13 15:38:26 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 348/1037] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:38:25 2023] GET /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227 => generated 1399 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:38:26 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-5f1f84ce-e1c0-4c7c-bedd-1d6ed4ded5f2 req-26e859dc-751b-4370-aec8-8d4d1041cf1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362ab343-a3a0-46e0-a0a7-c25e60133227", "name": "network-vif-unplugged", "status": "completed", "tag": "b70334b8-70db-4e5e-b2c9-11b514210eef"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:38:26 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-5f1f84ce-e1c0-4c7c-bedd-1d6ed4ded5f2 req-26e859dc-751b-4370-aec8-8d4d1041cf1a service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:38:26 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-5f1f84ce-e1c0-4c7c-bedd-1d6ed4ded5f2 req-26e859dc-751b-4370-aec8-8d4d1041cf1a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:38:26 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-5f1f84ce-e1c0-4c7c-bedd-1d6ed4ded5f2 req-26e859dc-751b-4370-aec8-8d4d1041cf1a service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:38:26 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-5f1f84ce-e1c0-4c7c-bedd-1d6ed4ded5f2 req-26e859dc-751b-4370-aec8-8d4d1041cf1a service nova] Creating event network-vif-unplugged:b70334b8-70db-4e5e-b2c9-11b514210eef for instance 362ab343-a3a0-46e0-a0a7-c25e60133227 on user Apr 13 15:38:26 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-5f1f84ce-e1c0-4c7c-bedd-1d6ed4ded5f2 req-26e859dc-751b-4370-aec8-8d4d1041cf1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044041 Apr 13 15:38:26 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 343/1038] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:38:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:38:28 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362ab343-a3a0-46e0-a0a7-c25e60133227", "name": "network-vif-plugged", "status": "completed", "tag": "b70334b8-70db-4e5e-b2c9-11b514210eef"}, {"server_uuid": "362ab343-a3a0-46e0-a0a7-c25e60133227", "name": "network-vif-plugged", "status": "completed", "tag": "b70334b8-70db-4e5e-b2c9-11b514210eef"}, {"server_uuid": "362ab343-a3a0-46e0-a0a7-c25e60133227", "name": "network-vif-deleted", "tag": "b70334b8-70db-4e5e-b2c9-11b514210eef"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:38:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:38:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:38:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:38:28 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] Creating event network-vif-plugged:b70334b8-70db-4e5e-b2c9-11b514210eef for instance 362ab343-a3a0-46e0-a0a7-c25e60133227 on user Apr 13 15:38:28 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] Creating event network-vif-plugged:b70334b8-70db-4e5e-b2c9-11b514210eef for instance 362ab343-a3a0-46e0-a0a7-c25e60133227 on user Apr 13 15:38:28 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] Creating event network-vif-deleted:b70334b8-70db-4e5e-b2c9-11b514210eef for instance 362ab343-a3a0-46e0-a0a7-c25e60133227 on user Apr 13 15:38:28 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.031899 Apr 13 15:38:28 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 348/1039] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:38:28 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:38:50 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-97418033-c084-46ec-9541-e0848fd21c63 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:38:50 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-97418033-c084-46ec-9541-e0848fd21c63 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:38:50 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:38:50 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=12 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:38:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-97418033-c084-46ec-9541-e0848fd21c63 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:38:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-97418033-c084-46ec-9541-e0848fd21c63 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:38:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-97418033-c084-46ec-9541-e0848fd21c63 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:38:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-97418033-c084-46ec-9541-e0848fd21c63 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:38:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-97418033-c084-46ec-9541-e0848fd21c63 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:38:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-97418033-c084-46ec-9541-e0848fd21c63 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:38:50 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-97418033-c084-46ec-9541-e0848fd21c63 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] HTTP exception thrown: Instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd could not be found. Apr 13 15:38:50 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-97418033-c084-46ec-9541-e0848fd21c63 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Request method failure captured: Apr 13 15:38:50 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd HTTP/1.1 Apr 13 15:38:50 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:38:50 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:38:50 user devstack@n-api.service[61873]: Connection: close Apr 13 15:38:50 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:38:50 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:38:50 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:38:50 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:38:50 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:38:50 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOCFOHe_QDCFmeUpvWe4rl9zXT3g3CYzZxKljzrpZ-u59JkCOV4lbDOYk1A-szzZ82TFSX2lUJ1y4LL-OrjUPwPJfa3GZiXg5648ic6FQB0LQQcfIaum0e9zqpbWXWWdnv1ijb1qOTGsEZzcoPHcr5UmPZs-ix5UgEGXb1XULFE1EG7E Apr 13 15:38:50 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:38:50 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:38:50 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:38:50 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:38:50 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:38:50 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:38:50 user devstack@n-api.service[61873]: X-Project-Id: a0a40f5a9b5e4f3fb8467b6ea304bbe5 Apr 13 15:38:50 user devstack@n-api.service[61873]: X-Project-Name: tempest-VolumesSnapshotTestJSON-392588653 Apr 13 15:38:50 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:38:50 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:38:50 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a0a40f5a9b5e4f3fb8467b6ea304bbe5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0a40f5a9b5e4f3fb8467b6ea304bbe5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0a40f5a9b5e4f3fb8467b6ea304bbe5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:38:50 user devstack@n-api.service[61873]: X-Tenant: tempest-VolumesSnapshotTestJSON-392588653 Apr 13 15:38:50 user devstack@n-api.service[61873]: X-Tenant-Id: a0a40f5a9b5e4f3fb8467b6ea304bbe5 Apr 13 15:38:50 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-392588653 Apr 13 15:38:50 user devstack@n-api.service[61873]: X-User: tempest-VolumesSnapshotTestJSON-392588653-project-member Apr 13 15:38:50 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:38:50 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:38:50 user devstack@n-api.service[61873]: X-User-Id: 300cbdea17c74a418f50e2d581691ad3 Apr 13 15:38:50 user devstack@n-api.service[61873]: X-User-Name: tempest-VolumesSnapshotTestJSON-392588653-project-member Apr 13 15:38:50 user devstack@n-api.service[61873]: method: > Apr 13 15:38:50 user devstack@n-api.service[61873]: exception: Instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd could not be found. Apr 13 15:38:50 user devstack@n-api.service[61873]: action_args: {'id': 'b2ed660b-7c9a-4a67-a48c-9bbbacc046bd'} Apr 13 15:38:50 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd could not be found. Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd could not be found. Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd could not be found. Apr 13 15:38:50 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:38:50 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-97418033-c084-46ec-9541-e0848fd21c63 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Returning 404 to user: Instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:38:50 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-97418033-c084-46ec-9541-e0848fd21c63 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" status: 404 len: 111 microversion: 2.1 time: 0.032255 Apr 13 15:38:50 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 349/1040] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:38:50 2023] GET /compute/v2.1/servers/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:38:59 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=4 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:38:59 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=4 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:38:59 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-198393882", "imageRef": "90e5cdd0-62b7-441b-9971-cfa8e8a0478d", "flavorRef": "42", "networks": [{"uuid": "aaec5536-e991-4d34-ba54-00b2bd705bd9"}]}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:38:59 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] validate_networks() for [('aaec5536-e991-4d34-ba54-00b2bd705bd9', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:39:00 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:39:00 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:39:00 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:39:00 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:39:00 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:39:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:00 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Getting quotas for project a0a40f5a9b5e4f3fb8467b6ea304bbe5. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:39:00 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Getting quotas for user 300cbdea17c74a418f50e2d581691ad3 and project a0a40f5a9b5e4f3fb8467b6ea304bbe5. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:39:00 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:39:00 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:39:00 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.787987 Apr 13 15:39:00 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 344/1041] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:38:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:39:00 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:39:00 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:39:00 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-cb5ce76f-69c1-45be-9717-ad4ba5132dd7 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:39:00 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-cb5ce76f-69c1-45be-9717-ad4ba5132dd7 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:39:00 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-cb5ce76f-69c1-45be-9717-ad4ba5132dd7 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300cbdea17c74a418f50e2d581691ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a40f5a9b5e4f3fb8467b6ea304bbe5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:39:00 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-cb5ce76f-69c1-45be-9717-ad4ba5132dd7 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9da338fc-f979-4df6-b83e-8cb78f97ac2c" status: 200 len: 1212 microversion: 2.1 time: 0.069868 Apr 13 15:39:00 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 349/1042] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:39:00 2023] GET /compute/v2.1/servers/9da338fc-f979-4df6-b83e-8cb78f97ac2c => generated 1212 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:39:02 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:39:02 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:39:02 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-88f4ab1b-243b-4ed0-bcab-24c80a287c95 req-b3268204-f32f-4923-9c61-7c3e0f906680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9da338fc-f979-4df6-b83e-8cb78f97ac2c", "tag": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:39:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-88f4ab1b-243b-4ed0-bcab-24c80a287c95 req-b3268204-f32f-4923-9c61-7c3e0f906680 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-88f4ab1b-243b-4ed0-bcab-24c80a287c95 req-b3268204-f32f-4923-9c61-7c3e0f906680 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:02 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-88f4ab1b-243b-4ed0-bcab-24c80a287c95 req-b3268204-f32f-4923-9c61-7c3e0f906680 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:02 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-88f4ab1b-243b-4ed0-bcab-24c80a287c95 req-b3268204-f32f-4923-9c61-7c3e0f906680 service nova] Creating event network-changed:9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d for instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c on user Apr 13 15:39:02 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-88f4ab1b-243b-4ed0-bcab-24c80a287c95 req-b3268204-f32f-4923-9c61-7c3e0f906680 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089351 Apr 13 15:39:02 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 350/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:39:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:39:04 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-df31308b-c873-492b-9ffe-4317bdd9797a req-226d1b04-952e-40b1-803c-9cb285bcca63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9da338fc-f979-4df6-b83e-8cb78f97ac2c", "name": "network-vif-plugged", "status": "completed", "tag": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:39:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-df31308b-c873-492b-9ffe-4317bdd9797a req-226d1b04-952e-40b1-803c-9cb285bcca63 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-df31308b-c873-492b-9ffe-4317bdd9797a req-226d1b04-952e-40b1-803c-9cb285bcca63 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:04 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-df31308b-c873-492b-9ffe-4317bdd9797a req-226d1b04-952e-40b1-803c-9cb285bcca63 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:04 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-df31308b-c873-492b-9ffe-4317bdd9797a req-226d1b04-952e-40b1-803c-9cb285bcca63 service nova] Creating event network-vif-plugged:9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d for instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c on user Apr 13 15:39:04 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-df31308b-c873-492b-9ffe-4317bdd9797a req-226d1b04-952e-40b1-803c-9cb285bcca63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029292 Apr 13 15:39:04 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 345/1044] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:39:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:39:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-a67f36e1-1021-4761-867a-889441dbb9bf req-a4969535-fdae-4be3-9724-f878c622ef55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9da338fc-f979-4df6-b83e-8cb78f97ac2c", "name": "network-vif-plugged", "status": "completed", "tag": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:39:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a67f36e1-1021-4761-867a-889441dbb9bf req-a4969535-fdae-4be3-9724-f878c622ef55 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a67f36e1-1021-4761-867a-889441dbb9bf req-a4969535-fdae-4be3-9724-f878c622ef55 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:06 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-a67f36e1-1021-4761-867a-889441dbb9bf req-a4969535-fdae-4be3-9724-f878c622ef55 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:06 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-a67f36e1-1021-4761-867a-889441dbb9bf req-a4969535-fdae-4be3-9724-f878c622ef55 service nova] Creating event network-vif-plugged:9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d for instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c on user Apr 13 15:39:06 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-a67f36e1-1021-4761-867a-889441dbb9bf req-a4969535-fdae-4be3-9724-f878c622ef55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028175 Apr 13 15:39:06 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 350/1045] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:39:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:39:09 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-32663b93-f356-4429-96f7-aff2895dd065 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:39:09 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-32663b93-f356-4429-96f7-aff2895dd065 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:39:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-32663b93-f356-4429-96f7-aff2895dd065 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-32663b93-f356-4429-96f7-aff2895dd065 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-32663b93-f356-4429-96f7-aff2895dd065 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-32663b93-f356-4429-96f7-aff2895dd065 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-32663b93-f356-4429-96f7-aff2895dd065 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-32663b93-f356-4429-96f7-aff2895dd065 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:09 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-32663b93-f356-4429-96f7-aff2895dd065 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0f7d9513b44bda8e53597cf7751ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc833ca51a84b6789f0def7357d4c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:39:09 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-32663b93-f356-4429-96f7-aff2895dd065 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37" status: 200 len: 1569 microversion: 2.1 time: 0.147666 Apr 13 15:39:09 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 351/1046] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:39:09 2023] GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:39:12 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:39:12 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:39:12 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-36b942a1-2aa6-4043-ad89-3163349ba33f req-1b90e38a-bf7f-4ab5-a722-e7a1ec97bc65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dccdbfbe-1261-490e-b8bf-b06e46d42f37", "tag": "bee671f2-48c8-41d0-945c-3c8b796aa286"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:39:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-36b942a1-2aa6-4043-ad89-3163349ba33f req-1b90e38a-bf7f-4ab5-a722-e7a1ec97bc65 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-36b942a1-2aa6-4043-ad89-3163349ba33f req-1b90e38a-bf7f-4ab5-a722-e7a1ec97bc65 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-36b942a1-2aa6-4043-ad89-3163349ba33f req-1b90e38a-bf7f-4ab5-a722-e7a1ec97bc65 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:12 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-36b942a1-2aa6-4043-ad89-3163349ba33f req-1b90e38a-bf7f-4ab5-a722-e7a1ec97bc65 service nova] Creating event network-changed:bee671f2-48c8-41d0-945c-3c8b796aa286 for instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 on user Apr 13 15:39:12 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-36b942a1-2aa6-4043-ad89-3163349ba33f req-1b90e38a-bf7f-4ab5-a722-e7a1ec97bc65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031344 Apr 13 15:39:12 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 346/1047] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:39:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:39:13 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:39:13 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23c7fbd7-2e84-41c8-b932-13e78019b008"}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:39:13 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:39:13 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:13 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:13 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:13 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:13 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:13 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:13 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303795 Apr 13 15:39:13 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 351/1048] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:39:13 2023] POST /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:39:16 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-da3d579b-cf57-4ad1-a39f-982c506c159c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:39:16 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-da3d579b-cf57-4ad1-a39f-982c506c159c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:39:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-da3d579b-cf57-4ad1-a39f-982c506c159c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-da3d579b-cf57-4ad1-a39f-982c506c159c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-da3d579b-cf57-4ad1-a39f-982c506c159c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-da3d579b-cf57-4ad1-a39f-982c506c159c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-da3d579b-cf57-4ad1-a39f-982c506c159c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:16 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-da3d579b-cf57-4ad1-a39f-982c506c159c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:16 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-da3d579b-cf57-4ad1-a39f-982c506c159c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HTTP exception thrown: Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 could not be found. Apr 13 15:39:16 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-da3d579b-cf57-4ad1-a39f-982c506c159c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Request method failure captured: Apr 13 15:39:16 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227 HTTP/1.1 Apr 13 15:39:16 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:39:16 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:39:16 user devstack@n-api.service[61873]: Connection: close Apr 13 15:39:16 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:39:16 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:39:16 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:39:16 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:39:16 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:39:16 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOCAkop2IkGDfTg_hLFhCzVF0r-Snnfp8mpD-rNTz3fSyNRaGCKUvuIX-bvQSQt24XSPbyAQXj1tiZH1C9TwK7awcWO7BHnx8xBG9YOZB63Dpng-DDIXtPRCA4OT9QRrpOESCL1mwTOYQNnj8ZeocbvX0wE2u-g1UjUjvIIUGz4v71K0 Apr 13 15:39:16 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:39:16 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:39:16 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:39:16 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:39:16 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:39:16 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:39:16 user devstack@n-api.service[61873]: X-Project-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:39:16 user devstack@n-api.service[61873]: X-Project-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:39:16 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:39:16 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:39:16 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:39:16 user devstack@n-api.service[61873]: X-Tenant: tempest-TestVolumeBootPattern-374778702 Apr 13 15:39:16 user devstack@n-api.service[61873]: X-Tenant-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:39:16 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:39:16 user devstack@n-api.service[61873]: X-User: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:39:16 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:39:16 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:39:16 user devstack@n-api.service[61873]: X-User-Id: 0307fb8d127a41079e34355904352231 Apr 13 15:39:16 user devstack@n-api.service[61873]: X-User-Name: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:39:16 user devstack@n-api.service[61873]: method: > Apr 13 15:39:16 user devstack@n-api.service[61873]: exception: Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 could not be found. Apr 13 15:39:16 user devstack@n-api.service[61873]: action_args: {'id': '362ab343-a3a0-46e0-a0a7-c25e60133227'} Apr 13 15:39:16 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 could not be found. Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 could not be found. Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 could not be found. Apr 13 15:39:16 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:39:16 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-da3d579b-cf57-4ad1-a39f-982c506c159c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Returning 404 to user: Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:39:16 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-da3d579b-cf57-4ad1-a39f-982c506c159c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227" status: 404 len: 111 microversion: 2.1 time: 0.028929 Apr 13 15:39:16 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 352/1049] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:39:16 2023] GET /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:39:16 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-50cf0c12-1302-418c-a443-125b79429092 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:39:16 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-50cf0c12-1302-418c-a443-125b79429092 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:39:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-50cf0c12-1302-418c-a443-125b79429092 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-50cf0c12-1302-418c-a443-125b79429092 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-50cf0c12-1302-418c-a443-125b79429092 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-50cf0c12-1302-418c-a443-125b79429092 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-50cf0c12-1302-418c-a443-125b79429092 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:16 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-50cf0c12-1302-418c-a443-125b79429092 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:16 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-50cf0c12-1302-418c-a443-125b79429092 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HTTP exception thrown: Instance a8e5dbae-1051-494e-9383-8d334bcd9f97 could not be found. Apr 13 15:39:16 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-50cf0c12-1302-418c-a443-125b79429092 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Request method failure captured: Apr 13 15:39:16 user devstack@n-api.service[61871]: request: DELETE /compute/v2.1/servers/a8e5dbae-1051-494e-9383-8d334bcd9f97 HTTP/1.1 Apr 13 15:39:16 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:39:16 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:39:16 user devstack@n-api.service[61871]: Connection: close Apr 13 15:39:16 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:39:16 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:39:16 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:39:16 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:39:16 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:39:16 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOCAkop2IkGDfTg_hLFhCzVF0r-Snnfp8mpD-rNTz3fSyNRaGCKUvuIX-bvQSQt24XSPbyAQXj1tiZH1C9TwK7awcWO7BHnx8xBG9YOZB63Dpng-DDIXtPRCA4OT9QRrpOESCL1mwTOYQNnj8ZeocbvX0wE2u-g1UjUjvIIUGz4v71K0 Apr 13 15:39:16 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:39:16 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:39:16 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:39:16 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:39:16 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:39:16 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:39:16 user devstack@n-api.service[61871]: X-Project-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:39:16 user devstack@n-api.service[61871]: X-Project-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:39:16 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:39:16 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:39:16 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:39:16 user devstack@n-api.service[61871]: X-Tenant: tempest-TestVolumeBootPattern-374778702 Apr 13 15:39:16 user devstack@n-api.service[61871]: X-Tenant-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:39:16 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:39:16 user devstack@n-api.service[61871]: X-User: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:39:16 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:39:16 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:39:16 user devstack@n-api.service[61871]: X-User-Id: 0307fb8d127a41079e34355904352231 Apr 13 15:39:16 user devstack@n-api.service[61871]: X-User-Name: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:39:16 user devstack@n-api.service[61871]: method: > Apr 13 15:39:16 user devstack@n-api.service[61871]: exception: Instance a8e5dbae-1051-494e-9383-8d334bcd9f97 could not be found. Apr 13 15:39:16 user devstack@n-api.service[61871]: action_args: {'id': 'a8e5dbae-1051-494e-9383-8d334bcd9f97'} Apr 13 15:39:16 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8e5dbae-1051-494e-9383-8d334bcd9f97 could not be found. Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8e5dbae-1051-494e-9383-8d334bcd9f97 could not be found. Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8e5dbae-1051-494e-9383-8d334bcd9f97 could not be found. Apr 13 15:39:16 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:39:16 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-50cf0c12-1302-418c-a443-125b79429092 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Returning 404 to user: Instance a8e5dbae-1051-494e-9383-8d334bcd9f97 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:39:16 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-50cf0c12-1302-418c-a443-125b79429092 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a8e5dbae-1051-494e-9383-8d334bcd9f97" status: 404 len: 111 microversion: 2.1 time: 0.035865 Apr 13 15:39:16 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 347/1050] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:39:16 2023] DELETE /compute/v2.1/servers/a8e5dbae-1051-494e-9383-8d334bcd9f97 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:39:16 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-55c84c62-8ee7-4cb6-bf05-d99b99f6bc22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:39:16 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-55c84c62-8ee7-4cb6-bf05-d99b99f6bc22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:39:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-55c84c62-8ee7-4cb6-bf05-d99b99f6bc22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-55c84c62-8ee7-4cb6-bf05-d99b99f6bc22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-55c84c62-8ee7-4cb6-bf05-d99b99f6bc22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-55c84c62-8ee7-4cb6-bf05-d99b99f6bc22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-55c84c62-8ee7-4cb6-bf05-d99b99f6bc22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:16 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-55c84c62-8ee7-4cb6-bf05-d99b99f6bc22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:16 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-55c84c62-8ee7-4cb6-bf05-d99b99f6bc22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HTTP exception thrown: Instance a8e5dbae-1051-494e-9383-8d334bcd9f97 could not be found. Apr 13 15:39:16 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-55c84c62-8ee7-4cb6-bf05-d99b99f6bc22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Request method failure captured: Apr 13 15:39:16 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/a8e5dbae-1051-494e-9383-8d334bcd9f97 HTTP/1.1 Apr 13 15:39:16 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:39:16 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:39:16 user devstack@n-api.service[61872]: Connection: close Apr 13 15:39:16 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:39:16 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:39:16 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:39:16 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:39:16 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:39:16 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOCAkop2IkGDfTg_hLFhCzVF0r-Snnfp8mpD-rNTz3fSyNRaGCKUvuIX-bvQSQt24XSPbyAQXj1tiZH1C9TwK7awcWO7BHnx8xBG9YOZB63Dpng-DDIXtPRCA4OT9QRrpOESCL1mwTOYQNnj8ZeocbvX0wE2u-g1UjUjvIIUGz4v71K0 Apr 13 15:39:16 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:39:16 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:39:16 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:39:16 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:39:16 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:39:16 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:39:16 user devstack@n-api.service[61872]: X-Project-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:39:16 user devstack@n-api.service[61872]: X-Project-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:39:16 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:39:16 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:39:16 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:39:16 user devstack@n-api.service[61872]: X-Tenant: tempest-TestVolumeBootPattern-374778702 Apr 13 15:39:16 user devstack@n-api.service[61872]: X-Tenant-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:39:16 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:39:16 user devstack@n-api.service[61872]: X-User: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:39:16 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:39:16 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:39:16 user devstack@n-api.service[61872]: X-User-Id: 0307fb8d127a41079e34355904352231 Apr 13 15:39:16 user devstack@n-api.service[61872]: X-User-Name: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:39:16 user devstack@n-api.service[61872]: method: > Apr 13 15:39:16 user devstack@n-api.service[61872]: exception: Instance a8e5dbae-1051-494e-9383-8d334bcd9f97 could not be found. Apr 13 15:39:16 user devstack@n-api.service[61872]: action_args: {'id': 'a8e5dbae-1051-494e-9383-8d334bcd9f97'} Apr 13 15:39:16 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8e5dbae-1051-494e-9383-8d334bcd9f97 could not be found. Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8e5dbae-1051-494e-9383-8d334bcd9f97 could not be found. Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8e5dbae-1051-494e-9383-8d334bcd9f97 could not be found. Apr 13 15:39:16 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:39:16 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-55c84c62-8ee7-4cb6-bf05-d99b99f6bc22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Returning 404 to user: Instance a8e5dbae-1051-494e-9383-8d334bcd9f97 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:39:16 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-55c84c62-8ee7-4cb6-bf05-d99b99f6bc22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8e5dbae-1051-494e-9383-8d334bcd9f97" status: 404 len: 111 microversion: 2.1 time: 0.032684 Apr 13 15:39:16 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 352/1051] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:39:16 2023] GET /compute/v2.1/servers/a8e5dbae-1051-494e-9383-8d334bcd9f97 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:39:17 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-8411808d-6c37-43a5-b74f-e449c5ca8f90 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:39:17 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-8411808d-6c37-43a5-b74f-e449c5ca8f90 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:39:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8411808d-6c37-43a5-b74f-e449c5ca8f90 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8411808d-6c37-43a5-b74f-e449c5ca8f90 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8411808d-6c37-43a5-b74f-e449c5ca8f90 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8411808d-6c37-43a5-b74f-e449c5ca8f90 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8411808d-6c37-43a5-b74f-e449c5ca8f90 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-8411808d-6c37-43a5-b74f-e449c5ca8f90 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:17 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-8411808d-6c37-43a5-b74f-e449c5ca8f90 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HTTP exception thrown: Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 could not be found. Apr 13 15:39:17 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-8411808d-6c37-43a5-b74f-e449c5ca8f90 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Request method failure captured: Apr 13 15:39:17 user devstack@n-api.service[61873]: request: DELETE /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227 HTTP/1.1 Apr 13 15:39:17 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:39:17 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:39:17 user devstack@n-api.service[61873]: Connection: close Apr 13 15:39:17 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:39:17 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:39:17 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:39:17 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:39:17 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:39:17 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOCAkop2IkGDfTg_hLFhCzVF0r-Snnfp8mpD-rNTz3fSyNRaGCKUvuIX-bvQSQt24XSPbyAQXj1tiZH1C9TwK7awcWO7BHnx8xBG9YOZB63Dpng-DDIXtPRCA4OT9QRrpOESCL1mwTOYQNnj8ZeocbvX0wE2u-g1UjUjvIIUGz4v71K0 Apr 13 15:39:17 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:39:17 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:39:17 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:39:17 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:39:17 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:39:17 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:39:17 user devstack@n-api.service[61873]: X-Project-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:39:17 user devstack@n-api.service[61873]: X-Project-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:39:17 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:39:17 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:39:17 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:39:17 user devstack@n-api.service[61873]: X-Tenant: tempest-TestVolumeBootPattern-374778702 Apr 13 15:39:17 user devstack@n-api.service[61873]: X-Tenant-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:39:17 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:39:17 user devstack@n-api.service[61873]: X-User: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:39:17 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:39:17 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:39:17 user devstack@n-api.service[61873]: X-User-Id: 0307fb8d127a41079e34355904352231 Apr 13 15:39:17 user devstack@n-api.service[61873]: X-User-Name: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:39:17 user devstack@n-api.service[61873]: method: > Apr 13 15:39:17 user devstack@n-api.service[61873]: exception: Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 could not be found. Apr 13 15:39:17 user devstack@n-api.service[61873]: action_args: {'id': '362ab343-a3a0-46e0-a0a7-c25e60133227'} Apr 13 15:39:17 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 could not be found. Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 could not be found. Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 could not be found. Apr 13 15:39:17 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:39:17 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-8411808d-6c37-43a5-b74f-e449c5ca8f90 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Returning 404 to user: Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:39:17 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-8411808d-6c37-43a5-b74f-e449c5ca8f90 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227" status: 404 len: 111 microversion: 2.1 time: 0.037048 Apr 13 15:39:17 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 353/1052] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:39:17 2023] DELETE /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:39:17 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-264994a9-bf76-4ad4-815b-c5eda9110b03 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:39:17 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-264994a9-bf76-4ad4-815b-c5eda9110b03 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:39:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-264994a9-bf76-4ad4-815b-c5eda9110b03 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-264994a9-bf76-4ad4-815b-c5eda9110b03 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-264994a9-bf76-4ad4-815b-c5eda9110b03 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-264994a9-bf76-4ad4-815b-c5eda9110b03 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-264994a9-bf76-4ad4-815b-c5eda9110b03 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-264994a9-bf76-4ad4-815b-c5eda9110b03 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:17 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-264994a9-bf76-4ad4-815b-c5eda9110b03 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HTTP exception thrown: Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 could not be found. Apr 13 15:39:17 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-264994a9-bf76-4ad4-815b-c5eda9110b03 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Request method failure captured: Apr 13 15:39:17 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227 HTTP/1.1 Apr 13 15:39:17 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:39:17 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:39:17 user devstack@n-api.service[61871]: Connection: close Apr 13 15:39:17 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:39:17 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:39:17 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:39:17 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:39:17 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:39:17 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOCAkop2IkGDfTg_hLFhCzVF0r-Snnfp8mpD-rNTz3fSyNRaGCKUvuIX-bvQSQt24XSPbyAQXj1tiZH1C9TwK7awcWO7BHnx8xBG9YOZB63Dpng-DDIXtPRCA4OT9QRrpOESCL1mwTOYQNnj8ZeocbvX0wE2u-g1UjUjvIIUGz4v71K0 Apr 13 15:39:17 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:39:17 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:39:17 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:39:17 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:39:17 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:39:17 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:39:17 user devstack@n-api.service[61871]: X-Project-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:39:17 user devstack@n-api.service[61871]: X-Project-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:39:17 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:39:17 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:39:17 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:39:17 user devstack@n-api.service[61871]: X-Tenant: tempest-TestVolumeBootPattern-374778702 Apr 13 15:39:17 user devstack@n-api.service[61871]: X-Tenant-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:39:17 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:39:17 user devstack@n-api.service[61871]: X-User: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:39:17 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:39:17 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:39:17 user devstack@n-api.service[61871]: X-User-Id: 0307fb8d127a41079e34355904352231 Apr 13 15:39:17 user devstack@n-api.service[61871]: X-User-Name: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:39:17 user devstack@n-api.service[61871]: method: > Apr 13 15:39:17 user devstack@n-api.service[61871]: exception: Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 could not be found. Apr 13 15:39:17 user devstack@n-api.service[61871]: action_args: {'id': '362ab343-a3a0-46e0-a0a7-c25e60133227'} Apr 13 15:39:17 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 could not be found. Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 could not be found. Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 could not be found. Apr 13 15:39:17 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:39:17 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-264994a9-bf76-4ad4-815b-c5eda9110b03 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Returning 404 to user: Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:39:17 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-264994a9-bf76-4ad4-815b-c5eda9110b03 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227" status: 404 len: 111 microversion: 2.1 time: 0.030802 Apr 13 15:39:17 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 348/1053] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:39:17 2023] GET /compute/v2.1/servers/362ab343-a3a0-46e0-a0a7-c25e60133227 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:39:17 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-63292da2-9e23-4631-a836-88ab1fc8b36a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Action: 'create', calling method: .version_select at 0x7f3a8f81c310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-534201410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvwV+aAKfg33qNc4wbr/2paTGAcc8SWvEWZnoIyM328VKubs+duvBPWYWegdOxTNyVK1CI/xe2k8VnkjZf7A2j1zik7CJLh6S5ckj/+pwbRpfx8pIYG6hJrUBOjoI8yqA=="}} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:39:17 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-63292da2-9e23-4631-a836-88ab1fc8b36a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting quotas for project d5d7f771264c4cd2bc595a2c525082d0. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:39:17 user devstack@n-api.service[61872]: DEBUG nova.quota [None req-63292da2-9e23-4631-a836-88ab1fc8b36a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting quotas for user 0307fb8d127a41079e34355904352231 and project d5d7f771264c4cd2bc595a2c525082d0. Resources: {'key_pairs'} {{(pid=61872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:39:17 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-63292da2-9e23-4631-a836-88ab1fc8b36a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.042101 Apr 13 15:39:17 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 353/1054] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 15:39:17 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:39:20 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-73bb1815-5529-417a-b866-0a3cabaa69de tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10091ac7-9208-40ca-84c9-8f64a428f436"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:39:20 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-73bb1815-5529-417a-b866-0a3cabaa69de tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:39:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-73bb1815-5529-417a-b866-0a3cabaa69de tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-73bb1815-5529-417a-b866-0a3cabaa69de tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-73bb1815-5529-417a-b866-0a3cabaa69de tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-73bb1815-5529-417a-b866-0a3cabaa69de tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-73bb1815-5529-417a-b866-0a3cabaa69de tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:20 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-73bb1815-5529-417a-b866-0a3cabaa69de tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:20 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-73bb1815-5529-417a-b866-0a3cabaa69de tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "POST /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.494942 Apr 13 15:39:20 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 354/1055] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 15:39:20 2023] POST /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380/os-volume_attachments => generated 188 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 15:39:20 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-59b46dc7-8876-4126-b6b9-d3daeaba6006 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:39:20 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-59b46dc7-8876-4126-b6b9-d3daeaba6006 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:39:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-59b46dc7-8876-4126-b6b9-d3daeaba6006 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-59b46dc7-8876-4126-b6b9-d3daeaba6006 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-59b46dc7-8876-4126-b6b9-d3daeaba6006 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-59b46dc7-8876-4126-b6b9-d3daeaba6006 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-59b46dc7-8876-4126-b6b9-d3daeaba6006 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:20 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-59b46dc7-8876-4126-b6b9-d3daeaba6006 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:21 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-59b46dc7-8876-4126-b6b9-d3daeaba6006 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380/os-volume_attachments/10091ac7-9208-40ca-84c9-8f64a428f436" status: 202 len: 0 microversion: 2.20 time: 0.243441 Apr 13 15:39:21 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 349/1056] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 15:39:20 2023] DELETE /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380/os-volume_attachments/10091ac7-9208-40ca-84c9-8f64a428f436 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:39:21 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:39:21 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:39:21 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:21 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:21 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:21 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:21 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:21 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:21 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61872) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 15:39:21 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "POST /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380/action" status: 202 len: 0 microversion: 2.20 time: 0.125673 Apr 13 15:39:21 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 354/1057] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 15:39:21 2023] POST /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:39:21 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-e508f3d1-6e33-42dc-a3c8-273efd98ff89 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:39:21 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-e508f3d1-6e33-42dc-a3c8-273efd98ff89 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:39:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e508f3d1-6e33-42dc-a3c8-273efd98ff89 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e508f3d1-6e33-42dc-a3c8-273efd98ff89 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e508f3d1-6e33-42dc-a3c8-273efd98ff89 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e508f3d1-6e33-42dc-a3c8-273efd98ff89 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e508f3d1-6e33-42dc-a3c8-273efd98ff89 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:21 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e508f3d1-6e33-42dc-a3c8-273efd98ff89 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:21 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1423782443", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-534201410", "security_groups": [{"name": "tempest-secgroup-smoke-945555796"}], "block_device_mapping_v2": [{"uuid": "0a9e3ad7-579a-414a-8143-d36ef6b41bf8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3"}]}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:39:21 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-e508f3d1-6e33-42dc-a3c8-273efd98ff89 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:39:21 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-e508f3d1-6e33-42dc-a3c8-273efd98ff89 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:39:21 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-e508f3d1-6e33-42dc-a3c8-273efd98ff89 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:39:21 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-e508f3d1-6e33-42dc-a3c8-273efd98ff89 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380" status: 200 len: 1661 microversion: 2.20 time: 0.233608 Apr 13 15:39:21 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 355/1058] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:39:21 2023] GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380 => generated 1661 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:39:21 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] validate_networks() for [('66ea8c1a-1c77-4a2a-ab35-64acac4762c3', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:39:22 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:39:22 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:39:22 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:39:22 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:39:22 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:39:22 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:22 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:22 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:22 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:22 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:22 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:22 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting quotas for project d5d7f771264c4cd2bc595a2c525082d0. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:39:22 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting quotas for user 0307fb8d127a41079e34355904352231 and project d5d7f771264c4cd2bc595a2c525082d0. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:39:22 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:39:22 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0a9e3ad7-579a-414a-8143-d36ef6b41bf8',volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:39:22 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.486019 Apr 13 15:39:22 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 350/1059] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:39:21 2023] POST /compute/v2.1/servers => generated 403 bytes in 1488 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:39:22 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-16e3c6ea-54ee-4f37-aaed-1ebb2b1a2c7c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:39:22 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-16e3c6ea-54ee-4f37-aaed-1ebb2b1a2c7c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:39:22 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-16e3c6ea-54ee-4f37-aaed-1ebb2b1a2c7c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:39:22 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-16e3c6ea-54ee-4f37-aaed-1ebb2b1a2c7c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12" status: 200 len: 1089 microversion: 2.1 time: 0.075279 Apr 13 15:39:22 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 355/1060] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:39:22 2023] GET /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12 => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:39:23 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-17d14721-7ebd-4a79-8f3d-b045e2064da2 req-71e445ac-6b49-4fbe-975d-bfa57a0e0ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b179d3-712f-47bc-94ad-387c8ca77380", "tag": "1cb2ae52-e4fa-4627-b3f3-301af5732358"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:39:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-17d14721-7ebd-4a79-8f3d-b045e2064da2 req-71e445ac-6b49-4fbe-975d-bfa57a0e0ab1 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-17d14721-7ebd-4a79-8f3d-b045e2064da2 req-71e445ac-6b49-4fbe-975d-bfa57a0e0ab1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:23 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-17d14721-7ebd-4a79-8f3d-b045e2064da2 req-71e445ac-6b49-4fbe-975d-bfa57a0e0ab1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:23 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-17d14721-7ebd-4a79-8f3d-b045e2064da2 req-71e445ac-6b49-4fbe-975d-bfa57a0e0ab1 service nova] Creating event network-changed:1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance 32b179d3-712f-47bc-94ad-387c8ca77380 on user Apr 13 15:39:23 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-17d14721-7ebd-4a79-8f3d-b045e2064da2 req-71e445ac-6b49-4fbe-975d-bfa57a0e0ab1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038121 Apr 13 15:39:23 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 356/1061] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:39:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:39:25 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-753e76a1-b0f3-4fd7-8454-2358522a72be req-1eb93a20-16ec-4cca-bced-79270b39ab57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a17bf49-ffae-4178-b484-6c45bd80fb12", "tag": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:39:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-753e76a1-b0f3-4fd7-8454-2358522a72be req-1eb93a20-16ec-4cca-bced-79270b39ab57 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-753e76a1-b0f3-4fd7-8454-2358522a72be req-1eb93a20-16ec-4cca-bced-79270b39ab57 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:25 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-753e76a1-b0f3-4fd7-8454-2358522a72be req-1eb93a20-16ec-4cca-bced-79270b39ab57 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:25 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-753e76a1-b0f3-4fd7-8454-2358522a72be req-1eb93a20-16ec-4cca-bced-79270b39ab57 service nova] Creating event network-changed:1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 for instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 on user Apr 13 15:39:25 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-753e76a1-b0f3-4fd7-8454-2358522a72be req-1eb93a20-16ec-4cca-bced-79270b39ab57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094153 Apr 13 15:39:25 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 351/1062] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:39:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:39:31 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-524686bc-7ddb-4a07-9b38-adfe1c6e3864 req-9b12d810-b944-4c90-8530-eb4ccebcac95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b179d3-712f-47bc-94ad-387c8ca77380", "name": "network-vif-plugged", "status": "completed", "tag": "1cb2ae52-e4fa-4627-b3f3-301af5732358"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:39:31 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:39:31 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-524686bc-7ddb-4a07-9b38-adfe1c6e3864 req-9b12d810-b944-4c90-8530-eb4ccebcac95 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:31 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-524686bc-7ddb-4a07-9b38-adfe1c6e3864 req-9b12d810-b944-4c90-8530-eb4ccebcac95 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:31 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-524686bc-7ddb-4a07-9b38-adfe1c6e3864 req-9b12d810-b944-4c90-8530-eb4ccebcac95 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:31 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:39:31 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-524686bc-7ddb-4a07-9b38-adfe1c6e3864 req-9b12d810-b944-4c90-8530-eb4ccebcac95 service nova] Creating event network-vif-plugged:1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance 32b179d3-712f-47bc-94ad-387c8ca77380 on user Apr 13 15:39:31 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-524686bc-7ddb-4a07-9b38-adfe1c6e3864 req-9b12d810-b944-4c90-8530-eb4ccebcac95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089303 Apr 13 15:39:31 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 356/1063] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:39:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:39:33 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-580dc033-034b-4a78-a5d6-1bcf2e71d1a5 req-14ea7a54-44ea-4435-9e75-bf3d244f1c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b179d3-712f-47bc-94ad-387c8ca77380", "name": "network-vif-plugged", "status": "completed", "tag": "1cb2ae52-e4fa-4627-b3f3-301af5732358"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:39:33 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=15 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:39:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-580dc033-034b-4a78-a5d6-1bcf2e71d1a5 req-14ea7a54-44ea-4435-9e75-bf3d244f1c6f service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-580dc033-034b-4a78-a5d6-1bcf2e71d1a5 req-14ea7a54-44ea-4435-9e75-bf3d244f1c6f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-580dc033-034b-4a78-a5d6-1bcf2e71d1a5 req-14ea7a54-44ea-4435-9e75-bf3d244f1c6f service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:33 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:39:33 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:39:33 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:39:33 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-12d16540-78db-411a-84da-92306487c55d req-af97b1e9-60a7-4c52-bc8e-fc8d8a883db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a17bf49-ffae-4178-b484-6c45bd80fb12", "name": "network-vif-plugged", "status": "completed", "tag": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:39:33 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-580dc033-034b-4a78-a5d6-1bcf2e71d1a5 req-14ea7a54-44ea-4435-9e75-bf3d244f1c6f service nova] Creating event network-vif-plugged:1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance 32b179d3-712f-47bc-94ad-387c8ca77380 on user Apr 13 15:39:33 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-580dc033-034b-4a78-a5d6-1bcf2e71d1a5 req-14ea7a54-44ea-4435-9e75-bf3d244f1c6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127363 Apr 13 15:39:33 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 357/1064] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:39:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:39:33 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:39:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-12d16540-78db-411a-84da-92306487c55d req-af97b1e9-60a7-4c52-bc8e-fc8d8a883db4 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-12d16540-78db-411a-84da-92306487c55d req-af97b1e9-60a7-4c52-bc8e-fc8d8a883db4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:33 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-12d16540-78db-411a-84da-92306487c55d req-af97b1e9-60a7-4c52-bc8e-fc8d8a883db4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:33 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:39:33 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-12d16540-78db-411a-84da-92306487c55d req-af97b1e9-60a7-4c52-bc8e-fc8d8a883db4 service nova] Creating event network-vif-plugged:1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 for instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 on user Apr 13 15:39:33 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-12d16540-78db-411a-84da-92306487c55d req-af97b1e9-60a7-4c52-bc8e-fc8d8a883db4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059796 Apr 13 15:39:33 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 352/1065] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:39:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:39:33 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:39:33 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:39:33 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:39:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:33 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:33 user devstack@n-api.service[61872]: DEBUG nova.objects.instance [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lazy-loading 'services' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=61872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:39:33 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments/23c7fbd7-2e84-41c8-b932-13e78019b008" status: 202 len: 0 microversion: 2.1 time: 0.333843 Apr 13 15:39:33 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 357/1066] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:39:33 2023] DELETE /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments/23c7fbd7-2e84-41c8-b932-13e78019b008 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:39:33 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-b4841e51-fdbf-4354-9b17-e8846ceab794 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:39:33 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-b4841e51-fdbf-4354-9b17-e8846ceab794 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:39:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b4841e51-fdbf-4354-9b17-e8846ceab794 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b4841e51-fdbf-4354-9b17-e8846ceab794 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b4841e51-fdbf-4354-9b17-e8846ceab794 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b4841e51-fdbf-4354-9b17-e8846ceab794 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b4841e51-fdbf-4354-9b17-e8846ceab794 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:33 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b4841e51-fdbf-4354-9b17-e8846ceab794 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:33 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-b4841e51-fdbf-4354-9b17-e8846ceab794 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049771 Apr 13 15:39:33 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 358/1067] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:39:33 2023] GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:39:35 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-e70c3f95-11d9-48af-8cb8-cb9c51377ce2 req-2e29f085-4c7c-432c-804f-bc1c6276136e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a17bf49-ffae-4178-b484-6c45bd80fb12", "name": "network-vif-plugged", "status": "completed", "tag": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:39:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-e70c3f95-11d9-48af-8cb8-cb9c51377ce2 req-2e29f085-4c7c-432c-804f-bc1c6276136e service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-e70c3f95-11d9-48af-8cb8-cb9c51377ce2 req-2e29f085-4c7c-432c-804f-bc1c6276136e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-e70c3f95-11d9-48af-8cb8-cb9c51377ce2 req-2e29f085-4c7c-432c-804f-bc1c6276136e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:35 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-e70c3f95-11d9-48af-8cb8-cb9c51377ce2 req-2e29f085-4c7c-432c-804f-bc1c6276136e service nova] Creating event network-vif-plugged:1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 for instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 on user Apr 13 15:39:35 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-e70c3f95-11d9-48af-8cb8-cb9c51377ce2 req-2e29f085-4c7c-432c-804f-bc1c6276136e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032238 Apr 13 15:39:35 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 353/1068] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:39:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:39:50 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-ba163bff-8f47-45e4-858d-49791407946c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:39:50 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-ba163bff-8f47-45e4-858d-49791407946c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:39:50 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=3 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:39:50 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=10,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:39:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ba163bff-8f47-45e4-858d-49791407946c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ba163bff-8f47-45e4-858d-49791407946c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ba163bff-8f47-45e4-858d-49791407946c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ba163bff-8f47-45e4-858d-49791407946c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:39:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ba163bff-8f47-45e4-858d-49791407946c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:39:50 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-ba163bff-8f47-45e4-858d-49791407946c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:39:50 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-ba163bff-8f47-45e4-858d-49791407946c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300cbdea17c74a418f50e2d581691ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a40f5a9b5e4f3fb8467b6ea304bbe5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:39:50 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-ba163bff-8f47-45e4-858d-49791407946c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9da338fc-f979-4df6-b83e-8cb78f97ac2c" status: 200 len: 1495 microversion: 2.1 time: 0.155236 Apr 13 15:39:50 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 358/1069] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:39:50 2023] GET /compute/v2.1/servers/9da338fc-f979-4df6-b83e-8cb78f97ac2c => generated 1495 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:40:11 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-5a8fc12a-8033-4ba7-b27d-ab088d38f44e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:40:11 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-5a8fc12a-8033-4ba7-b27d-ab088d38f44e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:40:11 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=3 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:40:11 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=7 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:40:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5a8fc12a-8033-4ba7-b27d-ab088d38f44e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:40:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5a8fc12a-8033-4ba7-b27d-ab088d38f44e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:40:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5a8fc12a-8033-4ba7-b27d-ab088d38f44e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:40:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5a8fc12a-8033-4ba7-b27d-ab088d38f44e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:40:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5a8fc12a-8033-4ba7-b27d-ab088d38f44e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:40:11 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-5a8fc12a-8033-4ba7-b27d-ab088d38f44e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:40:11 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-5a8fc12a-8033-4ba7-b27d-ab088d38f44e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:40:11 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-5a8fc12a-8033-4ba7-b27d-ab088d38f44e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:40:11 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-5a8fc12a-8033-4ba7-b27d-ab088d38f44e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:40:11 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-5a8fc12a-8033-4ba7-b27d-ab088d38f44e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380" status: 200 len: 1706 microversion: 2.20 time: 0.150175 Apr 13 15:40:11 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 359/1070] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:40:11 2023] GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380 => generated 1706 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 15:40:12 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:40:12 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:40:12 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-73930c7d-c128-437d-ae1c-7297549cf30e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:40:12 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-73930c7d-c128-437d-ae1c-7297549cf30e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:40:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-73930c7d-c128-437d-ae1c-7297549cf30e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:40:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-73930c7d-c128-437d-ae1c-7297549cf30e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:40:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-73930c7d-c128-437d-ae1c-7297549cf30e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:40:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-73930c7d-c128-437d-ae1c-7297549cf30e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:40:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-73930c7d-c128-437d-ae1c-7297549cf30e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:40:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-73930c7d-c128-437d-ae1c-7297549cf30e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:40:13 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-73930c7d-c128-437d-ae1c-7297549cf30e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:40:13 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-73930c7d-c128-437d-ae1c-7297549cf30e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12" status: 200 len: 1440 microversion: 2.1 time: 0.192850 Apr 13 15:40:13 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 354/1071] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:40:12 2023] GET /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12 => generated 1440 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:40:24 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-cc2f817e-1e72-418b-a6ee-7732183724b5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:40:24 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-cc2f817e-1e72-418b-a6ee-7732183724b5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:40:24 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:40:24 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:40:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cc2f817e-1e72-418b-a6ee-7732183724b5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:40:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cc2f817e-1e72-418b-a6ee-7732183724b5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:40:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cc2f817e-1e72-418b-a6ee-7732183724b5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:40:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cc2f817e-1e72-418b-a6ee-7732183724b5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:40:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cc2f817e-1e72-418b-a6ee-7732183724b5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:40:24 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-cc2f817e-1e72-418b-a6ee-7732183724b5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:40:24 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-cc2f817e-1e72-418b-a6ee-7732183724b5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046754 Apr 13 15:40:24 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 359/1072] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:40:24 2023] GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:40:26 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7a6c16d-f2af-483b-953d-4d178cc7eddb"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:40:26 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:40:26 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:40:26 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:40:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:40:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:40:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:40:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:40:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:40:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:40:27 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319698 Apr 13 15:40:27 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 360/1073] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:40:26 2023] POST /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:40:34 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:40:34 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:40:34 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:40:34 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:40:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:40:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:40:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:40:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:40:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:40:34 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:40:35 user devstack@n-api.service[61871]: DEBUG nova.objects.instance [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lazy-loading 'services' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=61871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:40:35 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments/c7a6c16d-f2af-483b-953d-4d178cc7eddb" status: 202 len: 0 microversion: 2.1 time: 0.183027 Apr 13 15:40:35 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 355/1074] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:40:34 2023] DELETE /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments/c7a6c16d-f2af-483b-953d-4d178cc7eddb => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:40:35 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-daaf41b4-73b1-41c0-98d6-847c174c9bc8 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:40:35 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-daaf41b4-73b1-41c0-98d6-847c174c9bc8 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:40:35 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:40:35 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:40:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-daaf41b4-73b1-41c0-98d6-847c174c9bc8 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:40:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-daaf41b4-73b1-41c0-98d6-847c174c9bc8 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:40:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-daaf41b4-73b1-41c0-98d6-847c174c9bc8 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:40:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-daaf41b4-73b1-41c0-98d6-847c174c9bc8 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:40:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-daaf41b4-73b1-41c0-98d6-847c174c9bc8 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:40:35 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-daaf41b4-73b1-41c0-98d6-847c174c9bc8 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:40:35 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-daaf41b4-73b1-41c0-98d6-847c174c9bc8 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055261 Apr 13 15:40:35 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 360/1075] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:40:35 2023] GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:40:50 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:40:50 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:40:50 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99abd4d3-940d-4f80-9687-89f043d58d7d", "device": "/dev/vdb"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:40:50 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:40:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:40:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:40:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:40:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:40:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:40:50 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:40:51 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9da338fc-f979-4df6-b83e-8cb78f97ac2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.357324 Apr 13 15:40:51 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 361/1076] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:40:50 2023] POST /compute/v2.1/servers/9da338fc-f979-4df6-b83e-8cb78f97ac2c/os-volume_attachments => generated 194 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:41:09 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:41:09 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:41:09 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:41:09 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:41:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:09 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:09 user devstack@n-api.service[61871]: DEBUG nova.objects.instance [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lazy-loading 'services' on Instance uuid 9da338fc-f979-4df6-b83e-8cb78f97ac2c {{(pid=61871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:41:09 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9da338fc-f979-4df6-b83e-8cb78f97ac2c/os-volume_attachments/99abd4d3-940d-4f80-9687-89f043d58d7d" status: 202 len: 0 microversion: 2.1 time: 0.162729 Apr 13 15:41:09 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 356/1077] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:41:09 2023] DELETE /compute/v2.1/servers/9da338fc-f979-4df6-b83e-8cb78f97ac2c/os-volume_attachments/99abd4d3-940d-4f80-9687-89f043d58d7d => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:41:09 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:41:09 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:41:09 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:41:09 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:41:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:09 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Going to try to terminate instance {{(pid=61872) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:41:09 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9da338fc-f979-4df6-b83e-8cb78f97ac2c" status: 204 len: 0 microversion: 2.1 time: 0.129328 Apr 13 15:41:09 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 361/1078] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:41:09 2023] DELETE /compute/v2.1/servers/9da338fc-f979-4df6-b83e-8cb78f97ac2c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:41:09 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:41:09 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:41:09 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7a326091-1e9b-47b5-85ff-2e3b719a3b54 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:41:09 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-7a326091-1e9b-47b5-85ff-2e3b719a3b54 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:41:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7a326091-1e9b-47b5-85ff-2e3b719a3b54 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7a326091-1e9b-47b5-85ff-2e3b719a3b54 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7a326091-1e9b-47b5-85ff-2e3b719a3b54 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7a326091-1e9b-47b5-85ff-2e3b719a3b54 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7a326091-1e9b-47b5-85ff-2e3b719a3b54 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:09 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7a326091-1e9b-47b5-85ff-2e3b719a3b54 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:10 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-7a326091-1e9b-47b5-85ff-2e3b719a3b54 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300cbdea17c74a418f50e2d581691ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a40f5a9b5e4f3fb8467b6ea304bbe5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:41:10 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7a326091-1e9b-47b5-85ff-2e3b719a3b54 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9da338fc-f979-4df6-b83e-8cb78f97ac2c" status: 200 len: 1547 microversion: 2.1 time: 0.219184 Apr 13 15:41:10 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 362/1079] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:41:09 2023] GET /compute/v2.1/servers/9da338fc-f979-4df6-b83e-8cb78f97ac2c => generated 1547 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:41:11 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-1dbcf91f-dfc1-486d-8a19-3f726d613dbd req-2efca7c9-0fa7-4f8c-bc7b-53f680fec3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9da338fc-f979-4df6-b83e-8cb78f97ac2c", "name": "network-vif-unplugged", "status": "completed", "tag": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:41:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-1dbcf91f-dfc1-486d-8a19-3f726d613dbd req-2efca7c9-0fa7-4f8c-bc7b-53f680fec3da service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-1dbcf91f-dfc1-486d-8a19-3f726d613dbd req-2efca7c9-0fa7-4f8c-bc7b-53f680fec3da service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:11 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-1dbcf91f-dfc1-486d-8a19-3f726d613dbd req-2efca7c9-0fa7-4f8c-bc7b-53f680fec3da service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:11 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-1dbcf91f-dfc1-486d-8a19-3f726d613dbd req-2efca7c9-0fa7-4f8c-bc7b-53f680fec3da service nova] Creating event network-vif-unplugged:9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d for instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c on user Apr 13 15:41:11 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-1dbcf91f-dfc1-486d-8a19-3f726d613dbd req-2efca7c9-0fa7-4f8c-bc7b-53f680fec3da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031804 Apr 13 15:41:11 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 357/1080] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:41:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:41:11 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-2b041464-d7bb-4cdc-bb69-06023978d01b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:41:11 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-2b041464-d7bb-4cdc-bb69-06023978d01b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:41:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2b041464-d7bb-4cdc-bb69-06023978d01b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2b041464-d7bb-4cdc-bb69-06023978d01b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2b041464-d7bb-4cdc-bb69-06023978d01b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2b041464-d7bb-4cdc-bb69-06023978d01b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2b041464-d7bb-4cdc-bb69-06023978d01b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:11 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-2b041464-d7bb-4cdc-bb69-06023978d01b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:12 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-2b041464-d7bb-4cdc-bb69-06023978d01b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042773 Apr 13 15:41:12 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 362/1081] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 15:41:11 2023] GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:41:12 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:41:12 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:41:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:12 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Going to try to terminate instance {{(pid=61873) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:41:12 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380" status: 204 len: 0 microversion: 2.20 time: 0.122298 Apr 13 15:41:12 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 363/1082] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 15:41:12 2023] DELETE /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 15:41:12 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-3730ff00-cd0a-4e4d-87e3-a33531b6394f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:41:12 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-3730ff00-cd0a-4e4d-87e3-a33531b6394f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:41:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-3730ff00-cd0a-4e4d-87e3-a33531b6394f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-3730ff00-cd0a-4e4d-87e3-a33531b6394f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-3730ff00-cd0a-4e4d-87e3-a33531b6394f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-3730ff00-cd0a-4e4d-87e3-a33531b6394f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-3730ff00-cd0a-4e4d-87e3-a33531b6394f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:12 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-3730ff00-cd0a-4e4d-87e3-a33531b6394f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:12 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-3730ff00-cd0a-4e4d-87e3-a33531b6394f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:41:12 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-3730ff00-cd0a-4e4d-87e3-a33531b6394f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:41:12 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-3730ff00-cd0a-4e4d-87e3-a33531b6394f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:41:12 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-3730ff00-cd0a-4e4d-87e3-a33531b6394f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380" status: 200 len: 1712 microversion: 2.20 time: 0.222550 Apr 13 15:41:12 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 358/1083] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:41:12 2023] GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380 => generated 1712 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 13 15:41:12 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-de71d93e-5095-4785-873f-5b936780176d req-dbf577e9-0e8e-460b-aa60-0bc9e5d56892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9da338fc-f979-4df6-b83e-8cb78f97ac2c", "name": "network-vif-deleted", "tag": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:41:12 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-de71d93e-5095-4785-873f-5b936780176d req-dbf577e9-0e8e-460b-aa60-0bc9e5d56892 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:12 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-de71d93e-5095-4785-873f-5b936780176d req-dbf577e9-0e8e-460b-aa60-0bc9e5d56892 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:12 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-de71d93e-5095-4785-873f-5b936780176d req-dbf577e9-0e8e-460b-aa60-0bc9e5d56892 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:12 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-de71d93e-5095-4785-873f-5b936780176d req-dbf577e9-0e8e-460b-aa60-0bc9e5d56892 service nova] Creating event network-vif-deleted:9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d for instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c on user Apr 13 15:41:12 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-de71d93e-5095-4785-873f-5b936780176d req-dbf577e9-0e8e-460b-aa60-0bc9e5d56892 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029360 Apr 13 15:41:12 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 363/1084] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:41:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:41:13 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-45e88cd3-1289-4a8b-ba6a-fcf5f337bd22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:41:13 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-45e88cd3-1289-4a8b-ba6a-fcf5f337bd22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:41:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-45e88cd3-1289-4a8b-ba6a-fcf5f337bd22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-45e88cd3-1289-4a8b-ba6a-fcf5f337bd22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-45e88cd3-1289-4a8b-ba6a-fcf5f337bd22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-45e88cd3-1289-4a8b-ba6a-fcf5f337bd22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-45e88cd3-1289-4a8b-ba6a-fcf5f337bd22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:13 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-45e88cd3-1289-4a8b-ba6a-fcf5f337bd22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:13 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-45e88cd3-1289-4a8b-ba6a-fcf5f337bd22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:41:13 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-45e88cd3-1289-4a8b-ba6a-fcf5f337bd22 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12" status: 200 len: 1440 microversion: 2.1 time: 0.291409 Apr 13 15:41:13 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 364/1085] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:41:13 2023] GET /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12 => generated 1440 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:41:13 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9da338fc-f979-4df6-b83e-8cb78f97ac2c", "name": "network-vif-plugged", "status": "completed", "tag": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d"}, {"server_uuid": "32b179d3-712f-47bc-94ad-387c8ca77380", "name": "network-vif-unplugged", "status": "completed", "tag": "1cb2ae52-e4fa-4627-b3f3-301af5732358"}, {"server_uuid": "32b179d3-712f-47bc-94ad-387c8ca77380", "name": "network-vif-plugged", "status": "completed", "tag": "1cb2ae52-e4fa-4627-b3f3-301af5732358"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:41:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:13 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:13 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] Creating event network-vif-plugged:9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d for instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c on user Apr 13 15:41:13 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] Creating event network-vif-unplugged:1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance 32b179d3-712f-47bc-94ad-387c8ca77380 on user Apr 13 15:41:13 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] Creating event network-vif-plugged:1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance 32b179d3-712f-47bc-94ad-387c8ca77380 on user Apr 13 15:41:13 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.033965 Apr 13 15:41:13 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 359/1086] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:41:13 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:41:14 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-233295cd-570f-4a24-b982-d91a35e6a53e req-8c56a83d-6fa0-4ebf-86f4-9b2627f58ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b179d3-712f-47bc-94ad-387c8ca77380", "name": "network-vif-deleted", "tag": "1cb2ae52-e4fa-4627-b3f3-301af5732358"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:41:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-233295cd-570f-4a24-b982-d91a35e6a53e req-8c56a83d-6fa0-4ebf-86f4-9b2627f58ea2 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-233295cd-570f-4a24-b982-d91a35e6a53e req-8c56a83d-6fa0-4ebf-86f4-9b2627f58ea2 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-233295cd-570f-4a24-b982-d91a35e6a53e req-8c56a83d-6fa0-4ebf-86f4-9b2627f58ea2 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:14 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-233295cd-570f-4a24-b982-d91a35e6a53e req-8c56a83d-6fa0-4ebf-86f4-9b2627f58ea2 service nova] Creating event network-vif-deleted:1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance 32b179d3-712f-47bc-94ad-387c8ca77380 on user Apr 13 15:41:14 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-233295cd-570f-4a24-b982-d91a35e6a53e req-8c56a83d-6fa0-4ebf-86f4-9b2627f58ea2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030067 Apr 13 15:41:14 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 364/1087] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:41:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:41:15 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:41:15 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:41:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:15 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Going to try to terminate instance {{(pid=61873) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:41:15 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12" status: 204 len: 0 microversion: 2.1 time: 0.107004 Apr 13 15:41:15 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 365/1088] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:41:15 2023] DELETE /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:41:15 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-1e95e4bd-ca67-4c09-8836-89f5623de1af tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:41:15 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-1e95e4bd-ca67-4c09-8836-89f5623de1af tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:41:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1e95e4bd-ca67-4c09-8836-89f5623de1af tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1e95e4bd-ca67-4c09-8836-89f5623de1af tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1e95e4bd-ca67-4c09-8836-89f5623de1af tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1e95e4bd-ca67-4c09-8836-89f5623de1af tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1e95e4bd-ca67-4c09-8836-89f5623de1af tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:15 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-1e95e4bd-ca67-4c09-8836-89f5623de1af tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:15 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-1e95e4bd-ca67-4c09-8836-89f5623de1af tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:41:15 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-1e95e4bd-ca67-4c09-8836-89f5623de1af tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12" status: 200 len: 1446 microversion: 2.1 time: 0.179543 Apr 13 15:41:15 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 360/1089] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:41:15 2023] GET /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12 => generated 1446 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:41:15 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-12da10c2-b540-4b47-996e-264a3ed8e1ff req-2e70f6b5-1253-499b-9a40-f7596232d785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a17bf49-ffae-4178-b484-6c45bd80fb12", "name": "network-vif-unplugged", "status": "completed", "tag": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:41:15 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-12da10c2-b540-4b47-996e-264a3ed8e1ff req-2e70f6b5-1253-499b-9a40-f7596232d785 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:15 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-12da10c2-b540-4b47-996e-264a3ed8e1ff req-2e70f6b5-1253-499b-9a40-f7596232d785 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:15 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-12da10c2-b540-4b47-996e-264a3ed8e1ff req-2e70f6b5-1253-499b-9a40-f7596232d785 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:15 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-12da10c2-b540-4b47-996e-264a3ed8e1ff req-2e70f6b5-1253-499b-9a40-f7596232d785 service nova] Creating event network-vif-unplugged:1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 for instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 on user Apr 13 15:41:15 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-12da10c2-b540-4b47-996e-264a3ed8e1ff req-2e70f6b5-1253-499b-9a40-f7596232d785 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032274 Apr 13 15:41:15 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 365/1090] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:41:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:41:15 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-bd84ed6d-7da2-474e-99ae-dc8af4511bde req-42e01a3a-c9e2-4d63-a058-fd37f67eca80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a17bf49-ffae-4178-b484-6c45bd80fb12", "tag": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:41:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-bd84ed6d-7da2-474e-99ae-dc8af4511bde req-42e01a3a-c9e2-4d63-a058-fd37f67eca80 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-bd84ed6d-7da2-474e-99ae-dc8af4511bde req-42e01a3a-c9e2-4d63-a058-fd37f67eca80 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:15 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-bd84ed6d-7da2-474e-99ae-dc8af4511bde req-42e01a3a-c9e2-4d63-a058-fd37f67eca80 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:15 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-bd84ed6d-7da2-474e-99ae-dc8af4511bde req-42e01a3a-c9e2-4d63-a058-fd37f67eca80 service nova] Creating event network-changed:1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 for instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 on user Apr 13 15:41:15 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-bd84ed6d-7da2-474e-99ae-dc8af4511bde req-42e01a3a-c9e2-4d63-a058-fd37f67eca80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040246 Apr 13 15:41:15 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 366/1091] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:41:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:41:17 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-5f3ef1aa-541d-44e2-94c4-5d9305b44c6d req-f6f916f7-f35f-4a8a-8220-9d7193279ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a17bf49-ffae-4178-b484-6c45bd80fb12", "name": "network-vif-deleted", "tag": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:41:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-5f3ef1aa-541d-44e2-94c4-5d9305b44c6d req-f6f916f7-f35f-4a8a-8220-9d7193279ca0 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-5f3ef1aa-541d-44e2-94c4-5d9305b44c6d req-f6f916f7-f35f-4a8a-8220-9d7193279ca0 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:17 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-5f3ef1aa-541d-44e2-94c4-5d9305b44c6d req-f6f916f7-f35f-4a8a-8220-9d7193279ca0 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:17 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-5f3ef1aa-541d-44e2-94c4-5d9305b44c6d req-f6f916f7-f35f-4a8a-8220-9d7193279ca0 service nova] Creating event network-vif-deleted:1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 for instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 on user Apr 13 15:41:17 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-5f3ef1aa-541d-44e2-94c4-5d9305b44c6d req-f6f916f7-f35f-4a8a-8220-9d7193279ca0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030974 Apr 13 15:41:17 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 361/1092] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:41:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 15:41:17 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-b47f4a87-5380-45b8-a9b5-2961b80a4301 req-ac4ec799-0ab5-46c2-b7a7-21637081024e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a17bf49-ffae-4178-b484-6c45bd80fb12", "name": "network-vif-plugged", "status": "completed", "tag": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:41:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-b47f4a87-5380-45b8-a9b5-2961b80a4301 req-ac4ec799-0ab5-46c2-b7a7-21637081024e service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-b47f4a87-5380-45b8-a9b5-2961b80a4301 req-ac4ec799-0ab5-46c2-b7a7-21637081024e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:17 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-b47f4a87-5380-45b8-a9b5-2961b80a4301 req-ac4ec799-0ab5-46c2-b7a7-21637081024e service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:17 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-b47f4a87-5380-45b8-a9b5-2961b80a4301 req-ac4ec799-0ab5-46c2-b7a7-21637081024e service nova] Creating event network-vif-plugged:1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 for instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 on user Apr 13 15:41:17 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-b47f4a87-5380-45b8-a9b5-2961b80a4301 req-ac4ec799-0ab5-46c2-b7a7-21637081024e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030715 Apr 13 15:41:17 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 366/1093] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:41:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:41:25 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-2d73a74c-fe7b-4ef0-b7e9-4370c9c40934 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:41:25 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-2d73a74c-fe7b-4ef0-b7e9-4370c9c40934 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:41:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2d73a74c-fe7b-4ef0-b7e9-4370c9c40934 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2d73a74c-fe7b-4ef0-b7e9-4370c9c40934 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2d73a74c-fe7b-4ef0-b7e9-4370c9c40934 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2d73a74c-fe7b-4ef0-b7e9-4370c9c40934 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2d73a74c-fe7b-4ef0-b7e9-4370c9c40934 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:25 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-2d73a74c-fe7b-4ef0-b7e9-4370c9c40934 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:25 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-2d73a74c-fe7b-4ef0-b7e9-4370c9c40934 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052842 Apr 13 15:41:25 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 367/1094] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:41:25 2023] GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:41:27 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=12 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:41:27 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:41:27 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe9ec691-ca66-4f4b-bdbd-9ce535037db7"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:41:27 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:41:27 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:27 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:27 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:27 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:27 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:27 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:28 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268077 Apr 13 15:41:28 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 362/1095] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:41:27 2023] POST /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:41:36 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:41:36 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:41:36 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:41:36 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:41:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:36 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:36 user devstack@n-api.service[61872]: DEBUG nova.objects.instance [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lazy-loading 'services' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=61872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:41:36 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments/fe9ec691-ca66-4f4b-bdbd-9ce535037db7" status: 202 len: 0 microversion: 2.1 time: 0.165466 Apr 13 15:41:36 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 367/1096] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:41:36 2023] DELETE /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments/fe9ec691-ca66-4f4b-bdbd-9ce535037db7 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:41:36 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7edc2990-4d39-47f4-af00-d52d608f2849 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:41:36 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-7edc2990-4d39-47f4-af00-d52d608f2849 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:41:36 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:41:36 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:41:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7edc2990-4d39-47f4-af00-d52d608f2849 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7edc2990-4d39-47f4-af00-d52d608f2849 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7edc2990-4d39-47f4-af00-d52d608f2849 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7edc2990-4d39-47f4-af00-d52d608f2849 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:41:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7edc2990-4d39-47f4-af00-d52d608f2849 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:41:36 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7edc2990-4d39-47f4-af00-d52d608f2849 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:41:36 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7edc2990-4d39-47f4-af00-d52d608f2849 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049881 Apr 13 15:41:36 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 368/1097] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:41:36 2023] GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:42:00 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-784fd67e-f225-4b9e-b20a-6e03d4f484c2 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:00 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-784fd67e-f225-4b9e-b20a-6e03d4f484c2 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:42:00 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:42:00 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:42:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-784fd67e-f225-4b9e-b20a-6e03d4f484c2 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-784fd67e-f225-4b9e-b20a-6e03d4f484c2 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-784fd67e-f225-4b9e-b20a-6e03d4f484c2 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-784fd67e-f225-4b9e-b20a-6e03d4f484c2 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-784fd67e-f225-4b9e-b20a-6e03d4f484c2 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:00 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-784fd67e-f225-4b9e-b20a-6e03d4f484c2 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:00 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-784fd67e-f225-4b9e-b20a-6e03d4f484c2 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] HTTP exception thrown: Instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c could not be found. Apr 13 15:42:00 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-784fd67e-f225-4b9e-b20a-6e03d4f484c2 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Request method failure captured: Apr 13 15:42:00 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/9da338fc-f979-4df6-b83e-8cb78f97ac2c HTTP/1.1 Apr 13 15:42:00 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:42:00 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:42:00 user devstack@n-api.service[61871]: Connection: close Apr 13 15:42:00 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:42:00 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:42:00 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:42:00 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:42:00 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:42:00 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOCFOHe_QDCFmeUpvWe4rl9zXT3g3CYzZxKljzrpZ-u59JkCOV4lbDOYk1A-szzZ82TFSX2lUJ1y4LL-OrjUPwPJfa3GZiXg5648ic6FQB0LQQcfIaum0e9zqpbWXWWdnv1ijb1qOTGsEZzcoPHcr5UmPZs-ix5UgEGXb1XULFE1EG7E Apr 13 15:42:00 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:42:00 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:42:00 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:42:00 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:42:00 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:42:00 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:42:00 user devstack@n-api.service[61871]: X-Project-Id: a0a40f5a9b5e4f3fb8467b6ea304bbe5 Apr 13 15:42:00 user devstack@n-api.service[61871]: X-Project-Name: tempest-VolumesSnapshotTestJSON-392588653 Apr 13 15:42:00 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:42:00 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:42:00 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a0a40f5a9b5e4f3fb8467b6ea304bbe5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0a40f5a9b5e4f3fb8467b6ea304bbe5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0a40f5a9b5e4f3fb8467b6ea304bbe5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:42:00 user devstack@n-api.service[61871]: X-Tenant: tempest-VolumesSnapshotTestJSON-392588653 Apr 13 15:42:00 user devstack@n-api.service[61871]: X-Tenant-Id: a0a40f5a9b5e4f3fb8467b6ea304bbe5 Apr 13 15:42:00 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-392588653 Apr 13 15:42:00 user devstack@n-api.service[61871]: X-User: tempest-VolumesSnapshotTestJSON-392588653-project-member Apr 13 15:42:00 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:42:00 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:42:00 user devstack@n-api.service[61871]: X-User-Id: 300cbdea17c74a418f50e2d581691ad3 Apr 13 15:42:00 user devstack@n-api.service[61871]: X-User-Name: tempest-VolumesSnapshotTestJSON-392588653-project-member Apr 13 15:42:00 user devstack@n-api.service[61871]: method: > Apr 13 15:42:00 user devstack@n-api.service[61871]: exception: Instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c could not be found. Apr 13 15:42:00 user devstack@n-api.service[61871]: action_args: {'id': '9da338fc-f979-4df6-b83e-8cb78f97ac2c'} Apr 13 15:42:00 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c could not be found. Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c could not be found. Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c could not be found. Apr 13 15:42:00 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:00 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-784fd67e-f225-4b9e-b20a-6e03d4f484c2 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Returning 404 to user: Instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:42:00 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-784fd67e-f225-4b9e-b20a-6e03d4f484c2 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9da338fc-f979-4df6-b83e-8cb78f97ac2c" status: 404 len: 111 microversion: 2.1 time: 0.037336 Apr 13 15:42:00 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 363/1098] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:42:00 2023] GET /compute/v2.1/servers/9da338fc-f979-4df6-b83e-8cb78f97ac2c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:42:02 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:42:02 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:42:02 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-3d1dbe5d-8cba-4db7-b437-c73e5073595b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:02 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-3d1dbe5d-8cba-4db7-b437-c73e5073595b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:42:02 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3d1dbe5d-8cba-4db7-b437-c73e5073595b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:02 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3d1dbe5d-8cba-4db7-b437-c73e5073595b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:02 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3d1dbe5d-8cba-4db7-b437-c73e5073595b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:02 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3d1dbe5d-8cba-4db7-b437-c73e5073595b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:02 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3d1dbe5d-8cba-4db7-b437-c73e5073595b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:02 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3d1dbe5d-8cba-4db7-b437-c73e5073595b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:02 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-3d1dbe5d-8cba-4db7-b437-c73e5073595b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] HTTP exception thrown: Instance 32b179d3-712f-47bc-94ad-387c8ca77380 could not be found. Apr 13 15:42:02 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-3d1dbe5d-8cba-4db7-b437-c73e5073595b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Request method failure captured: Apr 13 15:42:02 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380 HTTP/1.1 Apr 13 15:42:02 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:42:02 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:42:02 user devstack@n-api.service[61872]: Connection: close Apr 13 15:42:02 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:42:02 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:42:02 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:42:02 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:42:02 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:42:02 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOB-LGbKTLlqYQRDBIHqKQhR86k95R9MEB10QZuKYQqypeQa2aX2FvbirbV0mEwCe81--ds6HHp15m2ICVFfvhCf0lnr24yNr4ZTYgiv5Aw441CKEcYKKjLwLA6WSi0icvfuY63zpIXQFBms6BD1I2A2LGtFeZPX2M6gUhp1JxXHsxnM Apr 13 15:42:02 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:42:02 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:42:02 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:42:02 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:42:02 user devstack@n-api.service[61872]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 15:42:02 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:42:02 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:42:02 user devstack@n-api.service[61872]: X-Project-Id: 51df4613a6664a0fab857a9a83b6df62 Apr 13 15:42:02 user devstack@n-api.service[61872]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1608248430 Apr 13 15:42:02 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:42:02 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:42:02 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/51df4613a6664a0fab857a9a83b6df62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51df4613a6664a0fab857a9a83b6df62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51df4613a6664a0fab857a9a83b6df62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:42:02 user devstack@n-api.service[61872]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1608248430 Apr 13 15:42:02 user devstack@n-api.service[61872]: X-Tenant-Id: 51df4613a6664a0fab857a9a83b6df62 Apr 13 15:42:02 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1608248430 Apr 13 15:42:02 user devstack@n-api.service[61872]: X-User: tempest-AttachVolumeShelveTestJSON-1608248430-project-member Apr 13 15:42:02 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:42:02 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:42:02 user devstack@n-api.service[61872]: X-User-Id: a0bc1b61d8dc44aa8460fe2cd510c0a4 Apr 13 15:42:02 user devstack@n-api.service[61872]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1608248430-project-member Apr 13 15:42:02 user devstack@n-api.service[61872]: method: > Apr 13 15:42:02 user devstack@n-api.service[61872]: exception: Instance 32b179d3-712f-47bc-94ad-387c8ca77380 could not be found. Apr 13 15:42:02 user devstack@n-api.service[61872]: action_args: {'id': '32b179d3-712f-47bc-94ad-387c8ca77380'} Apr 13 15:42:02 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32b179d3-712f-47bc-94ad-387c8ca77380 could not be found. Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32b179d3-712f-47bc-94ad-387c8ca77380 could not be found. Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32b179d3-712f-47bc-94ad-387c8ca77380 could not be found. Apr 13 15:42:02 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:02 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-3d1dbe5d-8cba-4db7-b437-c73e5073595b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Returning 404 to user: Instance 32b179d3-712f-47bc-94ad-387c8ca77380 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:42:02 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-3d1dbe5d-8cba-4db7-b437-c73e5073595b tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380" status: 404 len: 111 microversion: 2.20 time: 0.035448 Apr 13 15:42:02 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 368/1099] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:42:02 2023] GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:42:02 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-685b10da-b621-4666-8cb2-226929f9c8f4 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '.version_select at 0x7f3a8bedb910>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:02 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:42:02 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:42:02 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-685b10da-b621-4666-8cb2-226929f9c8f4 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-249143367" status: 204 len: 0 microversion: 2.20 time: 0.031293 Apr 13 15:42:02 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 369/1100] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 13 15:42:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-249143367 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 15:42:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-ad102c80-415d-42ca-86c9-c2ee91160025 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:05 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-ad102c80-415d-42ca-86c9-c2ee91160025 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:42:05 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ad102c80-415d-42ca-86c9-c2ee91160025 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:05 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ad102c80-415d-42ca-86c9-c2ee91160025 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:05 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ad102c80-415d-42ca-86c9-c2ee91160025 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:05 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ad102c80-415d-42ca-86c9-c2ee91160025 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:05 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ad102c80-415d-42ca-86c9-c2ee91160025 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:05 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ad102c80-415d-42ca-86c9-c2ee91160025 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:05 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-ad102c80-415d-42ca-86c9-c2ee91160025 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] HTTP exception thrown: Instance 32b179d3-712f-47bc-94ad-387c8ca77380 could not be found. Apr 13 15:42:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-ad102c80-415d-42ca-86c9-c2ee91160025 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Request method failure captured: Apr 13 15:42:05 user devstack@n-api.service[61871]: request: DELETE /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380 HTTP/1.1 Apr 13 15:42:05 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:42:05 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:42:05 user devstack@n-api.service[61871]: Connection: close Apr 13 15:42:05 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:42:05 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:42:05 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:42:05 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:42:05 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:42:05 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOB-LGbKTLlqYQRDBIHqKQhR86k95R9MEB10QZuKYQqypeQa2aX2FvbirbV0mEwCe81--ds6HHp15m2ICVFfvhCf0lnr24yNr4ZTYgiv5Aw441CKEcYKKjLwLA6WSi0icvfuY63zpIXQFBms6BD1I2A2LGtFeZPX2M6gUhp1JxXHsxnM Apr 13 15:42:05 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:42:05 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:42:05 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:42:05 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:42:05 user devstack@n-api.service[61871]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 15:42:05 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:42:05 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:42:05 user devstack@n-api.service[61871]: X-Project-Id: 51df4613a6664a0fab857a9a83b6df62 Apr 13 15:42:05 user devstack@n-api.service[61871]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1608248430 Apr 13 15:42:05 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:42:05 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:42:05 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/51df4613a6664a0fab857a9a83b6df62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51df4613a6664a0fab857a9a83b6df62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51df4613a6664a0fab857a9a83b6df62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:42:05 user devstack@n-api.service[61871]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1608248430 Apr 13 15:42:05 user devstack@n-api.service[61871]: X-Tenant-Id: 51df4613a6664a0fab857a9a83b6df62 Apr 13 15:42:05 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1608248430 Apr 13 15:42:05 user devstack@n-api.service[61871]: X-User: tempest-AttachVolumeShelveTestJSON-1608248430-project-member Apr 13 15:42:05 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:42:05 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:42:05 user devstack@n-api.service[61871]: X-User-Id: a0bc1b61d8dc44aa8460fe2cd510c0a4 Apr 13 15:42:05 user devstack@n-api.service[61871]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1608248430-project-member Apr 13 15:42:05 user devstack@n-api.service[61871]: method: > Apr 13 15:42:05 user devstack@n-api.service[61871]: exception: Instance 32b179d3-712f-47bc-94ad-387c8ca77380 could not be found. Apr 13 15:42:05 user devstack@n-api.service[61871]: action_args: {'id': '32b179d3-712f-47bc-94ad-387c8ca77380'} Apr 13 15:42:05 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32b179d3-712f-47bc-94ad-387c8ca77380 could not be found. Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32b179d3-712f-47bc-94ad-387c8ca77380 could not be found. Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32b179d3-712f-47bc-94ad-387c8ca77380 could not be found. Apr 13 15:42:05 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-ad102c80-415d-42ca-86c9-c2ee91160025 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Returning 404 to user: Instance 32b179d3-712f-47bc-94ad-387c8ca77380 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:42:05 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-ad102c80-415d-42ca-86c9-c2ee91160025 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380" status: 404 len: 111 microversion: 2.20 time: 0.027382 Apr 13 15:42:05 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 364/1101] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 15:42:05 2023] DELETE /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:42:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-9f95c1ac-ef10-4a59-8334-f045d9378264 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:05 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-9f95c1ac-ef10-4a59-8334-f045d9378264 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:42:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9f95c1ac-ef10-4a59-8334-f045d9378264 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9f95c1ac-ef10-4a59-8334-f045d9378264 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9f95c1ac-ef10-4a59-8334-f045d9378264 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9f95c1ac-ef10-4a59-8334-f045d9378264 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9f95c1ac-ef10-4a59-8334-f045d9378264 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:05 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-9f95c1ac-ef10-4a59-8334-f045d9378264 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:05 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-9f95c1ac-ef10-4a59-8334-f045d9378264 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] HTTP exception thrown: Instance 32b179d3-712f-47bc-94ad-387c8ca77380 could not be found. Apr 13 15:42:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-9f95c1ac-ef10-4a59-8334-f045d9378264 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Request method failure captured: Apr 13 15:42:05 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380 HTTP/1.1 Apr 13 15:42:05 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:42:05 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:42:05 user devstack@n-api.service[61872]: Connection: close Apr 13 15:42:05 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:42:05 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:42:05 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:42:05 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:42:05 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:42:05 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOB-LGbKTLlqYQRDBIHqKQhR86k95R9MEB10QZuKYQqypeQa2aX2FvbirbV0mEwCe81--ds6HHp15m2ICVFfvhCf0lnr24yNr4ZTYgiv5Aw441CKEcYKKjLwLA6WSi0icvfuY63zpIXQFBms6BD1I2A2LGtFeZPX2M6gUhp1JxXHsxnM Apr 13 15:42:05 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:42:05 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:42:05 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:42:05 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:42:05 user devstack@n-api.service[61872]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 15:42:05 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:42:05 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:42:05 user devstack@n-api.service[61872]: X-Project-Id: 51df4613a6664a0fab857a9a83b6df62 Apr 13 15:42:05 user devstack@n-api.service[61872]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1608248430 Apr 13 15:42:05 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:42:05 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:42:05 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/51df4613a6664a0fab857a9a83b6df62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51df4613a6664a0fab857a9a83b6df62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51df4613a6664a0fab857a9a83b6df62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:42:05 user devstack@n-api.service[61872]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1608248430 Apr 13 15:42:05 user devstack@n-api.service[61872]: X-Tenant-Id: 51df4613a6664a0fab857a9a83b6df62 Apr 13 15:42:05 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1608248430 Apr 13 15:42:05 user devstack@n-api.service[61872]: X-User: tempest-AttachVolumeShelveTestJSON-1608248430-project-member Apr 13 15:42:05 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:42:05 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:42:05 user devstack@n-api.service[61872]: X-User-Id: a0bc1b61d8dc44aa8460fe2cd510c0a4 Apr 13 15:42:05 user devstack@n-api.service[61872]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1608248430-project-member Apr 13 15:42:05 user devstack@n-api.service[61872]: method: > Apr 13 15:42:05 user devstack@n-api.service[61872]: exception: Instance 32b179d3-712f-47bc-94ad-387c8ca77380 could not be found. Apr 13 15:42:05 user devstack@n-api.service[61872]: action_args: {'id': '32b179d3-712f-47bc-94ad-387c8ca77380'} Apr 13 15:42:05 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32b179d3-712f-47bc-94ad-387c8ca77380 could not be found. Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32b179d3-712f-47bc-94ad-387c8ca77380 could not be found. Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32b179d3-712f-47bc-94ad-387c8ca77380 could not be found. Apr 13 15:42:05 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:05 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-9f95c1ac-ef10-4a59-8334-f045d9378264 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Returning 404 to user: Instance 32b179d3-712f-47bc-94ad-387c8ca77380 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:42:05 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-9f95c1ac-ef10-4a59-8334-f045d9378264 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380" status: 404 len: 111 microversion: 2.20 time: 0.027972 Apr 13 15:42:05 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 369/1102] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:42:05 2023] GET /compute/v2.1/servers/32b179d3-712f-47bc-94ad-387c8ca77380 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:42:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-ff17ed67-d545-4440-b61c-09a6d7720bd1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:05 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-ff17ed67-d545-4440-b61c-09a6d7720bd1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:42:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ff17ed67-d545-4440-b61c-09a6d7720bd1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ff17ed67-d545-4440-b61c-09a6d7720bd1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ff17ed67-d545-4440-b61c-09a6d7720bd1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ff17ed67-d545-4440-b61c-09a6d7720bd1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ff17ed67-d545-4440-b61c-09a6d7720bd1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:05 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-ff17ed67-d545-4440-b61c-09a6d7720bd1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:05 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-ff17ed67-d545-4440-b61c-09a6d7720bd1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HTTP exception thrown: Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 could not be found. Apr 13 15:42:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-ff17ed67-d545-4440-b61c-09a6d7720bd1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Request method failure captured: Apr 13 15:42:05 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12 HTTP/1.1 Apr 13 15:42:05 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:42:05 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:42:05 user devstack@n-api.service[61873]: Connection: close Apr 13 15:42:05 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:42:05 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:42:05 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:42:05 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:42:05 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:42:05 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOCAkop2IkGDfTg_hLFhCzVF0r-Snnfp8mpD-rNTz3fSyNRaGCKUvuIX-bvQSQt24XSPbyAQXj1tiZH1C9TwK7awcWO7BHnx8xBG9YOZB63Dpng-DDIXtPRCA4OT9QRrpOESCL1mwTOYQNnj8ZeocbvX0wE2u-g1UjUjvIIUGz4v71K0 Apr 13 15:42:05 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:42:05 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:42:05 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:42:05 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:42:05 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:42:05 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:42:05 user devstack@n-api.service[61873]: X-Project-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:42:05 user devstack@n-api.service[61873]: X-Project-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:42:05 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:42:05 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:42:05 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:42:05 user devstack@n-api.service[61873]: X-Tenant: tempest-TestVolumeBootPattern-374778702 Apr 13 15:42:05 user devstack@n-api.service[61873]: X-Tenant-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:42:05 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:42:05 user devstack@n-api.service[61873]: X-User: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:42:05 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:42:05 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:42:05 user devstack@n-api.service[61873]: X-User-Id: 0307fb8d127a41079e34355904352231 Apr 13 15:42:05 user devstack@n-api.service[61873]: X-User-Name: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:42:05 user devstack@n-api.service[61873]: method: > Apr 13 15:42:05 user devstack@n-api.service[61873]: exception: Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 could not be found. Apr 13 15:42:05 user devstack@n-api.service[61873]: action_args: {'id': '4a17bf49-ffae-4178-b484-6c45bd80fb12'} Apr 13 15:42:05 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 could not be found. Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 could not be found. Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 could not be found. Apr 13 15:42:05 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:42:05 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-ff17ed67-d545-4440-b61c-09a6d7720bd1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Returning 404 to user: Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:42:05 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-ff17ed67-d545-4440-b61c-09a6d7720bd1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12" status: 404 len: 111 microversion: 2.1 time: 0.043248 Apr 13 15:42:05 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 370/1103] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:42:05 2023] GET /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:42:05 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-109801531", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-534201410", "security_groups": [{"name": "tempest-secgroup-smoke-945555796"}], "block_device_mapping_v2": [{"uuid": "0a9e3ad7-579a-414a-8143-d36ef6b41bf8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3"}]}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:42:05 user devstack@n-api.service[61871]: DEBUG nova.network.neutron [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] validate_networks() for [('66ea8c1a-1c77-4a2a-ab35-64acac4762c3', None, None, None, None, None)] {{(pid=61871) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:42:06 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:42:06 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image limits 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:42:06 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:42:06 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image pref 0:0:0 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:42:06 user devstack@n-api.service[61871]: DEBUG nova.virt.hardware [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:42:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:06 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:06 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting quotas for project d5d7f771264c4cd2bc595a2c525082d0. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:42:06 user devstack@n-api.service[61871]: DEBUG nova.quota [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting quotas for user 0307fb8d127a41079e34355904352231 and project d5d7f771264c4cd2bc595a2c525082d0. Resources: {'cores', 'instances', 'ram'} {{(pid=61871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:42:06 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Going to run 1 instances... {{(pid=61871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:42:06 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0a9e3ad7-579a-414a-8143-d36ef6b41bf8',volume_size=None,volume_type=None)] {{(pid=61871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:42:06 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.747315 Apr 13 15:42:06 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 365/1104] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:42:05 2023] POST /compute/v2.1/servers => generated 403 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:42:06 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-5054393d-08bf-41ba-8fa2-f569ba7a86bc tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:06 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-5054393d-08bf-41ba-8fa2-f569ba7a86bc tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:42:06 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-5054393d-08bf-41ba-8fa2-f569ba7a86bc tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:42:06 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-5054393d-08bf-41ba-8fa2-f569ba7a86bc tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53fa5a01-9d0a-480b-b1d3-028930c0e560" status: 200 len: 1088 microversion: 2.1 time: 0.068480 Apr 13 15:42:06 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 370/1105] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:42:06 2023] GET /compute/v2.1/servers/53fa5a01-9d0a-480b-b1d3-028930c0e560 => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:42:08 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-b01366fb-46c4-45ac-a58e-cc8ab7e7de29 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:08 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-b01366fb-46c4-45ac-a58e-cc8ab7e7de29 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:42:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b01366fb-46c4-45ac-a58e-cc8ab7e7de29 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b01366fb-46c4-45ac-a58e-cc8ab7e7de29 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b01366fb-46c4-45ac-a58e-cc8ab7e7de29 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b01366fb-46c4-45ac-a58e-cc8ab7e7de29 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b01366fb-46c4-45ac-a58e-cc8ab7e7de29 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:08 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-b01366fb-46c4-45ac-a58e-cc8ab7e7de29 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:08 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-b01366fb-46c4-45ac-a58e-cc8ab7e7de29 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] HTTP exception thrown: Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 could not be found. Apr 13 15:42:08 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-b01366fb-46c4-45ac-a58e-cc8ab7e7de29 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Request method failure captured: Apr 13 15:42:08 user devstack@n-api.service[61873]: request: DELETE /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87 HTTP/1.1 Apr 13 15:42:08 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:42:08 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:42:08 user devstack@n-api.service[61873]: Connection: close Apr 13 15:42:08 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:42:08 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:42:08 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:42:08 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:42:08 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:42:08 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOB-LGbKTLlqYQRDBIHqKQhR86k95R9MEB10QZuKYQqypeQa2aX2FvbirbV0mEwCe81--ds6HHp15m2ICVFfvhCf0lnr24yNr4ZTYgiv5Aw441CKEcYKKjLwLA6WSi0icvfuY63zpIXQFBms6BD1I2A2LGtFeZPX2M6gUhp1JxXHsxnM Apr 13 15:42:08 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:42:08 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:42:08 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:42:08 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:42:08 user devstack@n-api.service[61873]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 15:42:08 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:42:08 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:42:08 user devstack@n-api.service[61873]: X-Project-Id: 51df4613a6664a0fab857a9a83b6df62 Apr 13 15:42:08 user devstack@n-api.service[61873]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1608248430 Apr 13 15:42:08 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:42:08 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:42:08 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/51df4613a6664a0fab857a9a83b6df62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51df4613a6664a0fab857a9a83b6df62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51df4613a6664a0fab857a9a83b6df62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:42:08 user devstack@n-api.service[61873]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1608248430 Apr 13 15:42:08 user devstack@n-api.service[61873]: X-Tenant-Id: 51df4613a6664a0fab857a9a83b6df62 Apr 13 15:42:08 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1608248430 Apr 13 15:42:08 user devstack@n-api.service[61873]: X-User: tempest-AttachVolumeShelveTestJSON-1608248430-project-member Apr 13 15:42:08 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:42:08 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:42:08 user devstack@n-api.service[61873]: X-User-Id: a0bc1b61d8dc44aa8460fe2cd510c0a4 Apr 13 15:42:08 user devstack@n-api.service[61873]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1608248430-project-member Apr 13 15:42:08 user devstack@n-api.service[61873]: method: > Apr 13 15:42:08 user devstack@n-api.service[61873]: exception: Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 could not be found. Apr 13 15:42:08 user devstack@n-api.service[61873]: action_args: {'id': '9761101e-4bce-4e7b-8137-569bf8d27f87'} Apr 13 15:42:08 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 could not be found. Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 could not be found. Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 could not be found. Apr 13 15:42:08 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:42:08 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-b01366fb-46c4-45ac-a58e-cc8ab7e7de29 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Returning 404 to user: Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:42:08 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-b01366fb-46c4-45ac-a58e-cc8ab7e7de29 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87" status: 404 len: 111 microversion: 2.20 time: 0.041013 Apr 13 15:42:08 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 371/1106] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 15:42:08 2023] DELETE /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 15:42:08 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-fe604308-5d22-41b7-8574-5209247e4431 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:08 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-fe604308-5d22-41b7-8574-5209247e4431 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:42:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fe604308-5d22-41b7-8574-5209247e4431 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fe604308-5d22-41b7-8574-5209247e4431 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fe604308-5d22-41b7-8574-5209247e4431 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fe604308-5d22-41b7-8574-5209247e4431 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fe604308-5d22-41b7-8574-5209247e4431 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:08 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-fe604308-5d22-41b7-8574-5209247e4431 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:08 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-fe604308-5d22-41b7-8574-5209247e4431 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] HTTP exception thrown: Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 could not be found. Apr 13 15:42:08 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-fe604308-5d22-41b7-8574-5209247e4431 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Request method failure captured: Apr 13 15:42:08 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87 HTTP/1.1 Apr 13 15:42:08 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:42:08 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:42:08 user devstack@n-api.service[61871]: Connection: close Apr 13 15:42:08 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:42:08 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:42:08 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:42:08 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:42:08 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:42:08 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOB-LGbKTLlqYQRDBIHqKQhR86k95R9MEB10QZuKYQqypeQa2aX2FvbirbV0mEwCe81--ds6HHp15m2ICVFfvhCf0lnr24yNr4ZTYgiv5Aw441CKEcYKKjLwLA6WSi0icvfuY63zpIXQFBms6BD1I2A2LGtFeZPX2M6gUhp1JxXHsxnM Apr 13 15:42:08 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:42:08 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:42:08 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:42:08 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:42:08 user devstack@n-api.service[61871]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 15:42:08 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:42:08 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:42:08 user devstack@n-api.service[61871]: X-Project-Id: 51df4613a6664a0fab857a9a83b6df62 Apr 13 15:42:08 user devstack@n-api.service[61871]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1608248430 Apr 13 15:42:08 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:42:08 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:42:08 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/51df4613a6664a0fab857a9a83b6df62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51df4613a6664a0fab857a9a83b6df62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51df4613a6664a0fab857a9a83b6df62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:42:08 user devstack@n-api.service[61871]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1608248430 Apr 13 15:42:08 user devstack@n-api.service[61871]: X-Tenant-Id: 51df4613a6664a0fab857a9a83b6df62 Apr 13 15:42:08 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1608248430 Apr 13 15:42:08 user devstack@n-api.service[61871]: X-User: tempest-AttachVolumeShelveTestJSON-1608248430-project-member Apr 13 15:42:08 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:42:08 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:42:08 user devstack@n-api.service[61871]: X-User-Id: a0bc1b61d8dc44aa8460fe2cd510c0a4 Apr 13 15:42:08 user devstack@n-api.service[61871]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1608248430-project-member Apr 13 15:42:08 user devstack@n-api.service[61871]: method: > Apr 13 15:42:08 user devstack@n-api.service[61871]: exception: Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 could not be found. Apr 13 15:42:08 user devstack@n-api.service[61871]: action_args: {'id': '9761101e-4bce-4e7b-8137-569bf8d27f87'} Apr 13 15:42:08 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 could not be found. Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 could not be found. Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 could not be found. Apr 13 15:42:08 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:08 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-fe604308-5d22-41b7-8574-5209247e4431 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Returning 404 to user: Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:42:08 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-fe604308-5d22-41b7-8574-5209247e4431 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87" status: 404 len: 111 microversion: 2.20 time: 0.036169 Apr 13 15:42:08 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 366/1107] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 15:42:08 2023] GET /compute/v2.1/servers/9761101e-4bce-4e7b-8137-569bf8d27f87 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 13 15:42:09 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-bccdd63e-b338-4a72-9200-2de025659207 req-d5ba0bc2-3005-4a3d-abaf-dae1702d7204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53fa5a01-9d0a-480b-b1d3-028930c0e560", "tag": "9fd4d123-8854-4643-8716-914a4c5694e3"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:42:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-bccdd63e-b338-4a72-9200-2de025659207 req-d5ba0bc2-3005-4a3d-abaf-dae1702d7204 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-bccdd63e-b338-4a72-9200-2de025659207 req-d5ba0bc2-3005-4a3d-abaf-dae1702d7204 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:09 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-bccdd63e-b338-4a72-9200-2de025659207 req-d5ba0bc2-3005-4a3d-abaf-dae1702d7204 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:09 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-bccdd63e-b338-4a72-9200-2de025659207 req-d5ba0bc2-3005-4a3d-abaf-dae1702d7204 service nova] Creating event network-changed:9fd4d123-8854-4643-8716-914a4c5694e3 for instance 53fa5a01-9d0a-480b-b1d3-028930c0e560 on user Apr 13 15:42:09 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-bccdd63e-b338-4a72-9200-2de025659207 req-d5ba0bc2-3005-4a3d-abaf-dae1702d7204 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031702 Apr 13 15:42:09 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 371/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:42:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:42:14 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-4892f049-4601-4cbd-8192-f5dbfe1cdfce tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Action: 'create', calling method: .version_select at 0x7f3a8bd4ca60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1066874910"}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:42:14 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-4892f049-4601-4cbd-8192-f5dbfe1cdfce tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.691031 Apr 13 15:42:14 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 372/1109] 10.0.0.210 () {64 vars in 1232 bytes} [Thu Apr 13 15:42:13 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 693 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 13 15:42:14 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-cd29da2b-39b0-4eaa-84d0-b52382596e5a tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Calling method '.version_select at 0x7f3a8fb11990>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:14 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-cd29da2b-39b0-4eaa-84d0-b52382596e5a tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3dfae14e-824f-40bb-8f9b-138fe517ed1b" status: 200 len: 345 microversion: 2.1 time: 0.081049 Apr 13 15:42:14 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 367/1110] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 15:42:14 2023] GET /compute/v2.1/os-volumes/3dfae14e-824f-40bb-8f9b-138fe517ed1b => generated 345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:42:15 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-0b8739d1-fbd1-4c91-92f9-4a3fe3e18bea req-ad2a3781-ff79-459d-a422-2900cb544f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53fa5a01-9d0a-480b-b1d3-028930c0e560", "name": "network-vif-plugged", "status": "completed", "tag": "9fd4d123-8854-4643-8716-914a4c5694e3"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:42:15 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-0b8739d1-fbd1-4c91-92f9-4a3fe3e18bea req-ad2a3781-ff79-459d-a422-2900cb544f02 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:15 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-0b8739d1-fbd1-4c91-92f9-4a3fe3e18bea req-ad2a3781-ff79-459d-a422-2900cb544f02 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:15 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-0b8739d1-fbd1-4c91-92f9-4a3fe3e18bea req-ad2a3781-ff79-459d-a422-2900cb544f02 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:15 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-0b8739d1-fbd1-4c91-92f9-4a3fe3e18bea req-ad2a3781-ff79-459d-a422-2900cb544f02 service nova] Creating event network-vif-plugged:9fd4d123-8854-4643-8716-914a4c5694e3 for instance 53fa5a01-9d0a-480b-b1d3-028930c0e560 on user Apr 13 15:42:15 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-0b8739d1-fbd1-4c91-92f9-4a3fe3e18bea req-ad2a3781-ff79-459d-a422-2900cb544f02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031830 Apr 13 15:42:15 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 372/1111] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:42:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:42:15 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-b113a6ce-efb0-43df-8ec1-a2301dd17ee9 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Calling method '.version_select at 0x7f3a8bd4e830>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:15 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-b113a6ce-efb0-43df-8ec1-a2301dd17ee9 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3dfae14e-824f-40bb-8f9b-138fe517ed1b" status: 200 len: 346 microversion: 2.1 time: 0.076452 Apr 13 15:42:15 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 373/1112] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 15:42:15 2023] GET /compute/v2.1/os-volumes/3dfae14e-824f-40bb-8f9b-138fe517ed1b => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:42:15 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-915aab52-c769-4214-bc09-4cf9edac34b4 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Action: 'create', calling method: .version_select at 0x7f3a8f82fb50>, body: {"snapshot": {"volume_id": "3dfae14e-824f-40bb-8f9b-138fe517ed1b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-547198537"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:42:15 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-915aab52-c769-4214-bc09-4cf9edac34b4 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.211936 Apr 13 15:42:15 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 368/1113] 10.0.0.210 () {64 vars in 1239 bytes} [Thu Apr 13 15:42:15 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:42:15 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-113fe994-c768-40e2-8b5c-98c5770f5efe tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Calling method '.version_select at 0x7f3a8fa5f010>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:15 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-113fe994-c768-40e2-8b5c-98c5770f5efe tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/6594288a-bb0d-4113-b694-c4e02ecebce4" status: 200 len: 286 microversion: 2.1 time: 0.051829 Apr 13 15:42:15 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 373/1114] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 15:42:15 2023] GET /compute/v2.1/os-snapshots/6594288a-bb0d-4113-b694-c4e02ecebce4 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:42:15 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-717ad9d9-8f6a-4015-b12f-c983fb0443b8 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Calling method '.version_select at 0x7f3a8b7c1870>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:15 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-717ad9d9-8f6a-4015-b12f-c983fb0443b8 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.038946 Apr 13 15:42:15 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 374/1115] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 13 15:42:15 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:42:15 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-f25ed1c5-9463-4e23-add7-757ecd07e0cd tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Calling method '.version_select at 0x7f3a8faa4040>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:15 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-f25ed1c5-9463-4e23-add7-757ecd07e0cd tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/6594288a-bb0d-4113-b694-c4e02ecebce4" status: 200 len: 286 microversion: 2.1 time: 0.033498 Apr 13 15:42:15 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 369/1116] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 15:42:15 2023] GET /compute/v2.1/os-snapshots/6594288a-bb0d-4113-b694-c4e02ecebce4 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:42:17 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:42:17 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-12cc7171-5a64-42d9-b5fc-310a86367670 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Calling method '.version_select at 0x7f3a8f795090>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:17 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-12cc7171-5a64-42d9-b5fc-310a86367670 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/6594288a-bb0d-4113-b694-c4e02ecebce4" status: 200 len: 286 microversion: 2.1 time: 0.050153 Apr 13 15:42:17 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 374/1117] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 15:42:17 2023] GET /compute/v2.1/os-snapshots/6594288a-bb0d-4113-b694-c4e02ecebce4 => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:42:17 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-e6e107e1-4fed-470f-881b-bbe1ae146144 req-380335b3-10c1-4ef9-9b39-ace864db3c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53fa5a01-9d0a-480b-b1d3-028930c0e560", "name": "network-vif-plugged", "status": "completed", "tag": "9fd4d123-8854-4643-8716-914a4c5694e3"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:42:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-e6e107e1-4fed-470f-881b-bbe1ae146144 req-380335b3-10c1-4ef9-9b39-ace864db3c97 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-e6e107e1-4fed-470f-881b-bbe1ae146144 req-380335b3-10c1-4ef9-9b39-ace864db3c97 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:17 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-e6e107e1-4fed-470f-881b-bbe1ae146144 req-380335b3-10c1-4ef9-9b39-ace864db3c97 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:17 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-e6e107e1-4fed-470f-881b-bbe1ae146144 req-380335b3-10c1-4ef9-9b39-ace864db3c97 service nova] Creating event network-vif-plugged:9fd4d123-8854-4643-8716-914a4c5694e3 for instance 53fa5a01-9d0a-480b-b1d3-028930c0e560 on user Apr 13 15:42:17 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-e6e107e1-4fed-470f-881b-bbe1ae146144 req-380335b3-10c1-4ef9-9b39-ace864db3c97 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029993 Apr 13 15:42:17 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 375/1118] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:42:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:42:18 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:42:18 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell0:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:42:18 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-d65b4037-39d9-45df-9b3a-d55c241b4891 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Calling method '.version_select at 0x7f3a8ff129e0>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:18 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-d65b4037-39d9-45df-9b3a-d55c241b4891 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/6594288a-bb0d-4113-b694-c4e02ecebce4" status: 200 len: 287 microversion: 2.1 time: 0.054550 Apr 13 15:42:18 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 370/1119] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 15:42:18 2023] GET /compute/v2.1/os-snapshots/6594288a-bb0d-4113-b694-c4e02ecebce4 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:42:18 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-41071dc6-7046-4226-8dd4-e29e0a514179 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Calling method '.version_select at 0x7f3a912912d0>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:18 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-41071dc6-7046-4226-8dd4-e29e0a514179 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/6594288a-bb0d-4113-b694-c4e02ecebce4" status: 202 len: 0 microversion: 2.1 time: 0.075300 Apr 13 15:42:18 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 375/1120] 10.0.0.210 () {62 vars in 1331 bytes} [Thu Apr 13 15:42:18 2023] DELETE /compute/v2.1/os-snapshots/6594288a-bb0d-4113-b694-c4e02ecebce4 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 15:42:18 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-e22ccb90-7a2e-4299-9da2-0c62b8456a81 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Calling method '.version_select at 0x7f3a8bd4dcf0>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:18 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-e22ccb90-7a2e-4299-9da2-0c62b8456a81 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/6594288a-bb0d-4113-b694-c4e02ecebce4" status: 200 len: 286 microversion: 2.1 time: 0.044314 Apr 13 15:42:18 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 376/1121] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 15:42:18 2023] GET /compute/v2.1/os-snapshots/6594288a-bb0d-4113-b694-c4e02ecebce4 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:42:19 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:42:19 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=8 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:42:19 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-04b2c20e-c98d-4491-a9b1-00fde326f6fb tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Calling method '.version_select at 0x7f3a8fb109d0>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:19 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-04b2c20e-c98d-4491-a9b1-00fde326f6fb tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/6594288a-bb0d-4113-b694-c4e02ecebce4" status: 200 len: 286 microversion: 2.1 time: 0.039994 Apr 13 15:42:19 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 371/1122] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 15:42:19 2023] GET /compute/v2.1/os-snapshots/6594288a-bb0d-4113-b694-c4e02ecebce4 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:42:20 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e9477cb4-1e2c-4e47-8f2b-e818d427e5d3 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Calling method '.version_select at 0x7f3a8f796290>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:20 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-e9477cb4-1e2c-4e47-8f2b-e818d427e5d3 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] HTTP exception thrown: Snapshot 6594288a-bb0d-4113-b694-c4e02ecebce4 could not be found. Apr 13 15:42:20 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e9477cb4-1e2c-4e47-8f2b-e818d427e5d3 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Request method failure captured: Apr 13 15:42:20 user devstack@n-api.service[61872]: request: GET /compute/v2.1/os-snapshots/6594288a-bb0d-4113-b694-c4e02ecebce4 HTTP/1.1 Apr 13 15:42:20 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:42:20 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:42:20 user devstack@n-api.service[61872]: Connection: close Apr 13 15:42:20 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:42:20 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:42:20 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:42:20 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:42:20 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:42:20 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOCLVUw_-fQXXzqojUD7vU0dgTVaJleT-zxZjf9-YQqzgg4ljVMxxiCMFersxdwmebamyx3KaTojbuq7sjBiwiVqx7f8Vsxno3EiZ9muvv_0yTH4R7R9n8nYGIYCzq2HJYVltyiG2QXi4-Wjj7FB7PbzuyeyNo9-Kp1i_6JI22uKQrPw Apr 13 15:42:20 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:42:20 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:42:20 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:42:20 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:42:20 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:42:20 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:42:20 user devstack@n-api.service[61872]: X-Project-Id: fc0fd6527c264c1985e4b383a3380acc Apr 13 15:42:20 user devstack@n-api.service[61872]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1908171401 Apr 13 15:42:20 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:42:20 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:42:20 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fc0fd6527c264c1985e4b383a3380acc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fc0fd6527c264c1985e4b383a3380acc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fc0fd6527c264c1985e4b383a3380acc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:42:20 user devstack@n-api.service[61872]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1908171401 Apr 13 15:42:20 user devstack@n-api.service[61872]: X-Tenant-Id: fc0fd6527c264c1985e4b383a3380acc Apr 13 15:42:20 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1908171401 Apr 13 15:42:20 user devstack@n-api.service[61872]: X-User: tempest-VolumesSnapshotsTestJSON-1908171401-project-member Apr 13 15:42:20 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:42:20 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:42:20 user devstack@n-api.service[61872]: X-User-Id: c8ebf571ef8c43a49424f6b629fa2e64 Apr 13 15:42:20 user devstack@n-api.service[61872]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1908171401-project-member Apr 13 15:42:20 user devstack@n-api.service[61872]: method: Apr 13 15:42:20 user devstack@n-api.service[61872]: exception: Snapshot 6594288a-bb0d-4113-b694-c4e02ecebce4 could not be found. Apr 13 15:42:20 user devstack@n-api.service[61872]: action_args: {'id': '6594288a-bb0d-4113-b694-c4e02ecebce4'} Apr 13 15:42:20 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6594288a-bb0d-4113-b694-c4e02ecebce4 could not be found. (HTTP 404) (Request-ID: req-19348694-40cb-4ca8-b487-35bb5265cd89) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6594288a-bb0d-4113-b694-c4e02ecebce4 could not be found. Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6594288a-bb0d-4113-b694-c4e02ecebce4 could not be found. Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6594288a-bb0d-4113-b694-c4e02ecebce4 could not be found. Apr 13 15:42:20 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:20 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-e9477cb4-1e2c-4e47-8f2b-e818d427e5d3 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Returning 404 to user: Snapshot 6594288a-bb0d-4113-b694-c4e02ecebce4 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:42:20 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-e9477cb4-1e2c-4e47-8f2b-e818d427e5d3 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/6594288a-bb0d-4113-b694-c4e02ecebce4" status: 404 len: 111 microversion: 2.1 time: 0.051295 Apr 13 15:42:20 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 376/1123] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 15:42:20 2023] GET /compute/v2.1/os-snapshots/6594288a-bb0d-4113-b694-c4e02ecebce4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:42:20 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-3558a2fa-44ef-463d-9f70-0f6eeafdf640 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Calling method '.version_select at 0x7f3a8b80b010>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:20 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-3558a2fa-44ef-463d-9f70-0f6eeafdf640 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/3dfae14e-824f-40bb-8f9b-138fe517ed1b" status: 202 len: 0 microversion: 2.1 time: 0.075827 Apr 13 15:42:20 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 377/1124] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 15:42:20 2023] DELETE /compute/v2.1/os-volumes/3dfae14e-824f-40bb-8f9b-138fe517ed1b => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:42:20 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-7fa2d4df-339a-418e-bc4f-bd2c5e65d04e tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Calling method '.version_select at 0x7f3a8f8775b0>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:20 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-7fa2d4df-339a-418e-bc4f-bd2c5e65d04e tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3dfae14e-824f-40bb-8f9b-138fe517ed1b" status: 200 len: 345 microversion: 2.1 time: 0.109883 Apr 13 15:42:20 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 372/1125] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 15:42:20 2023] GET /compute/v2.1/os-volumes/3dfae14e-824f-40bb-8f9b-138fe517ed1b => generated 345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:42:21 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-7b0f5119-a1b1-4e94-bb8e-9705919503ac tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Calling method '.version_select at 0x7f3a8f797250>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:21 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-7b0f5119-a1b1-4e94-bb8e-9705919503ac tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3dfae14e-824f-40bb-8f9b-138fe517ed1b" status: 200 len: 345 microversion: 2.1 time: 0.057156 Apr 13 15:42:21 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 377/1126] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 15:42:21 2023] GET /compute/v2.1/os-volumes/3dfae14e-824f-40bb-8f9b-138fe517ed1b => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:42:22 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c4dac9a4-bfdd-4ee4-9c41-f67d5b1cdc7d tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Calling method '.version_select at 0x7f3a8bb66050>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:22 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-c4dac9a4-bfdd-4ee4-9c41-f67d5b1cdc7d tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] HTTP exception thrown: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. Apr 13 15:42:22 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c4dac9a4-bfdd-4ee4-9c41-f67d5b1cdc7d tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Request method failure captured: Apr 13 15:42:22 user devstack@n-api.service[61873]: request: GET /compute/v2.1/os-volumes/3dfae14e-824f-40bb-8f9b-138fe517ed1b HTTP/1.1 Apr 13 15:42:22 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:42:22 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:42:22 user devstack@n-api.service[61873]: Connection: close Apr 13 15:42:22 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:42:22 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:42:22 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:42:22 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:42:22 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:42:22 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOCLVUw_-fQXXzqojUD7vU0dgTVaJleT-zxZjf9-YQqzgg4ljVMxxiCMFersxdwmebamyx3KaTojbuq7sjBiwiVqx7f8Vsxno3EiZ9muvv_0yTH4R7R9n8nYGIYCzq2HJYVltyiG2QXi4-Wjj7FB7PbzuyeyNo9-Kp1i_6JI22uKQrPw Apr 13 15:42:22 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:42:22 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:42:22 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:42:22 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:42:22 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:42:22 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:42:22 user devstack@n-api.service[61873]: X-Project-Id: fc0fd6527c264c1985e4b383a3380acc Apr 13 15:42:22 user devstack@n-api.service[61873]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1908171401 Apr 13 15:42:22 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:42:22 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:42:22 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fc0fd6527c264c1985e4b383a3380acc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fc0fd6527c264c1985e4b383a3380acc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fc0fd6527c264c1985e4b383a3380acc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:42:22 user devstack@n-api.service[61873]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1908171401 Apr 13 15:42:22 user devstack@n-api.service[61873]: X-Tenant-Id: fc0fd6527c264c1985e4b383a3380acc Apr 13 15:42:22 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1908171401 Apr 13 15:42:22 user devstack@n-api.service[61873]: X-User: tempest-VolumesSnapshotsTestJSON-1908171401-project-member Apr 13 15:42:22 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:42:22 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:42:22 user devstack@n-api.service[61873]: X-User-Id: c8ebf571ef8c43a49424f6b629fa2e64 Apr 13 15:42:22 user devstack@n-api.service[61873]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1908171401-project-member Apr 13 15:42:22 user devstack@n-api.service[61873]: method: Apr 13 15:42:22 user devstack@n-api.service[61873]: exception: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. Apr 13 15:42:22 user devstack@n-api.service[61873]: action_args: {'id': '3dfae14e-824f-40bb-8f9b-138fe517ed1b'} Apr 13 15:42:22 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. (HTTP 404) (Request-ID: req-5457f1c3-0394-413b-b3d5-45de4700c333) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. Apr 13 15:42:22 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c4dac9a4-bfdd-4ee4-9c41-f67d5b1cdc7d tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Returning 404 to user: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:42:22 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-c4dac9a4-bfdd-4ee4-9c41-f67d5b1cdc7d tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3dfae14e-824f-40bb-8f9b-138fe517ed1b" status: 404 len: 109 microversion: 2.1 time: 0.052216 Apr 13 15:42:22 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 378/1127] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 15:42:22 2023] GET /compute/v2.1/os-volumes/3dfae14e-824f-40bb-8f9b-138fe517ed1b => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:42:22 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-3077f79e-9a47-4c68-aafe-48f08cb212d3 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Calling method '.version_select at 0x7f3a8fe73d90>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:22 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-3077f79e-9a47-4c68-aafe-48f08cb212d3 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] HTTP exception thrown: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. Apr 13 15:42:22 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-3077f79e-9a47-4c68-aafe-48f08cb212d3 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Request method failure captured: Apr 13 15:42:22 user devstack@n-api.service[61871]: request: DELETE /compute/v2.1/os-volumes/3dfae14e-824f-40bb-8f9b-138fe517ed1b HTTP/1.1 Apr 13 15:42:22 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:42:22 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:42:22 user devstack@n-api.service[61871]: Connection: close Apr 13 15:42:22 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:42:22 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:42:22 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:42:22 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:42:22 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:42:22 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOCLVUw_-fQXXzqojUD7vU0dgTVaJleT-zxZjf9-YQqzgg4ljVMxxiCMFersxdwmebamyx3KaTojbuq7sjBiwiVqx7f8Vsxno3EiZ9muvv_0yTH4R7R9n8nYGIYCzq2HJYVltyiG2QXi4-Wjj7FB7PbzuyeyNo9-Kp1i_6JI22uKQrPw Apr 13 15:42:22 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:42:22 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:42:22 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:42:22 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:42:22 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:42:22 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:42:22 user devstack@n-api.service[61871]: X-Project-Id: fc0fd6527c264c1985e4b383a3380acc Apr 13 15:42:22 user devstack@n-api.service[61871]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1908171401 Apr 13 15:42:22 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:42:22 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:42:22 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fc0fd6527c264c1985e4b383a3380acc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fc0fd6527c264c1985e4b383a3380acc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fc0fd6527c264c1985e4b383a3380acc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:42:22 user devstack@n-api.service[61871]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1908171401 Apr 13 15:42:22 user devstack@n-api.service[61871]: X-Tenant-Id: fc0fd6527c264c1985e4b383a3380acc Apr 13 15:42:22 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1908171401 Apr 13 15:42:22 user devstack@n-api.service[61871]: X-User: tempest-VolumesSnapshotsTestJSON-1908171401-project-member Apr 13 15:42:22 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:42:22 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:42:22 user devstack@n-api.service[61871]: X-User-Id: c8ebf571ef8c43a49424f6b629fa2e64 Apr 13 15:42:22 user devstack@n-api.service[61871]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1908171401-project-member Apr 13 15:42:22 user devstack@n-api.service[61871]: method: Apr 13 15:42:22 user devstack@n-api.service[61871]: exception: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. Apr 13 15:42:22 user devstack@n-api.service[61871]: action_args: {'id': '3dfae14e-824f-40bb-8f9b-138fe517ed1b'} Apr 13 15:42:22 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. (HTTP 404) (Request-ID: req-51200b2c-d01f-4588-8199-0b6c0ee90c8f) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. Apr 13 15:42:22 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-3077f79e-9a47-4c68-aafe-48f08cb212d3 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Returning 404 to user: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:42:22 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-3077f79e-9a47-4c68-aafe-48f08cb212d3 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/3dfae14e-824f-40bb-8f9b-138fe517ed1b" status: 404 len: 109 microversion: 2.1 time: 0.038575 Apr 13 15:42:22 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 373/1128] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 15:42:22 2023] DELETE /compute/v2.1/os-volumes/3dfae14e-824f-40bb-8f9b-138fe517ed1b => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:42:22 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-b4c4534e-027f-46a8-9a58-bf594db36c04 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Calling method '.version_select at 0x7f3a8f8f4f70>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:22 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-b4c4534e-027f-46a8-9a58-bf594db36c04 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] HTTP exception thrown: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. Apr 13 15:42:22 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-b4c4534e-027f-46a8-9a58-bf594db36c04 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Request method failure captured: Apr 13 15:42:22 user devstack@n-api.service[61872]: request: GET /compute/v2.1/os-volumes/3dfae14e-824f-40bb-8f9b-138fe517ed1b HTTP/1.1 Apr 13 15:42:22 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:42:22 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:42:22 user devstack@n-api.service[61872]: Connection: close Apr 13 15:42:22 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:42:22 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:42:22 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:42:22 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:42:22 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:42:22 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOCLVUw_-fQXXzqojUD7vU0dgTVaJleT-zxZjf9-YQqzgg4ljVMxxiCMFersxdwmebamyx3KaTojbuq7sjBiwiVqx7f8Vsxno3EiZ9muvv_0yTH4R7R9n8nYGIYCzq2HJYVltyiG2QXi4-Wjj7FB7PbzuyeyNo9-Kp1i_6JI22uKQrPw Apr 13 15:42:22 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:42:22 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:42:22 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:42:22 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:42:22 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:42:22 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:42:22 user devstack@n-api.service[61872]: X-Project-Id: fc0fd6527c264c1985e4b383a3380acc Apr 13 15:42:22 user devstack@n-api.service[61872]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1908171401 Apr 13 15:42:22 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:42:22 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:42:22 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fc0fd6527c264c1985e4b383a3380acc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fc0fd6527c264c1985e4b383a3380acc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fc0fd6527c264c1985e4b383a3380acc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:42:22 user devstack@n-api.service[61872]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1908171401 Apr 13 15:42:22 user devstack@n-api.service[61872]: X-Tenant-Id: fc0fd6527c264c1985e4b383a3380acc Apr 13 15:42:22 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1908171401 Apr 13 15:42:22 user devstack@n-api.service[61872]: X-User: tempest-VolumesSnapshotsTestJSON-1908171401-project-member Apr 13 15:42:22 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:42:22 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:42:22 user devstack@n-api.service[61872]: X-User-Id: c8ebf571ef8c43a49424f6b629fa2e64 Apr 13 15:42:22 user devstack@n-api.service[61872]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1908171401-project-member Apr 13 15:42:22 user devstack@n-api.service[61872]: method: Apr 13 15:42:22 user devstack@n-api.service[61872]: exception: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. Apr 13 15:42:22 user devstack@n-api.service[61872]: action_args: {'id': '3dfae14e-824f-40bb-8f9b-138fe517ed1b'} Apr 13 15:42:22 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. (HTTP 404) (Request-ID: req-86033ea4-0cba-41f4-b3c8-973dac24f7c4) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. Apr 13 15:42:22 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:42:22 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-b4c4534e-027f-46a8-9a58-bf594db36c04 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] Returning 404 to user: Volume 3dfae14e-824f-40bb-8f9b-138fe517ed1b could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:42:22 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-b4c4534e-027f-46a8-9a58-bf594db36c04 tempest-VolumesSnapshotsTestJSON-1908171401 tempest-VolumesSnapshotsTestJSON-1908171401-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3dfae14e-824f-40bb-8f9b-138fe517ed1b" status: 404 len: 109 microversion: 2.1 time: 0.041551 Apr 13 15:42:22 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 378/1129] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 15:42:22 2023] GET /compute/v2.1/os-volumes/3dfae14e-824f-40bb-8f9b-138fe517ed1b => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:42:26 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-4a441b4a-dad6-4e3a-80c9-f0e59bfee67b tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:26 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-4a441b4a-dad6-4e3a-80c9-f0e59bfee67b tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:42:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4a441b4a-dad6-4e3a-80c9-f0e59bfee67b tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4a441b4a-dad6-4e3a-80c9-f0e59bfee67b tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4a441b4a-dad6-4e3a-80c9-f0e59bfee67b tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4a441b4a-dad6-4e3a-80c9-f0e59bfee67b tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4a441b4a-dad6-4e3a-80c9-f0e59bfee67b tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:26 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-4a441b4a-dad6-4e3a-80c9-f0e59bfee67b tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:26 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-4a441b4a-dad6-4e3a-80c9-f0e59bfee67b tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.203449 Apr 13 15:42:26 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 379/1130] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:42:26 2023] GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments => generated 25 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:42:29 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba76dc10-d310-49d5-983c-7b6a11cc28ef"}} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:42:29 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:42:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:29 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:29 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402418 Apr 13 15:42:29 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 374/1131] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 15:42:29 2023] POST /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments => generated 194 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:42:37 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=12 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:42:37 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=8 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:42:37 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:37 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:42:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:37 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:38 user devstack@n-api.service[61872]: DEBUG nova.objects.instance [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lazy-loading 'services' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=61872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 15:42:38 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments/ba76dc10-d310-49d5-983c-7b6a11cc28ef" status: 202 len: 0 microversion: 2.1 time: 0.199160 Apr 13 15:42:38 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 379/1132] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 15:42:37 2023] DELETE /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments/ba76dc10-d310-49d5-983c-7b6a11cc28ef => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:42:38 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-83a77ac8-47d2-4c7f-b769-a238813bdd39 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:38 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-83a77ac8-47d2-4c7f-b769-a238813bdd39 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:42:38 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:42:38 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=12 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:42:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-83a77ac8-47d2-4c7f-b769-a238813bdd39 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-83a77ac8-47d2-4c7f-b769-a238813bdd39 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-83a77ac8-47d2-4c7f-b769-a238813bdd39 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-83a77ac8-47d2-4c7f-b769-a238813bdd39 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-83a77ac8-47d2-4c7f-b769-a238813bdd39 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:38 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-83a77ac8-47d2-4c7f-b769-a238813bdd39 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:38 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-83a77ac8-47d2-4c7f-b769-a238813bdd39 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052517 Apr 13 15:42:38 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 380/1133] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:42:38 2023] GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:42:56 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:42:56 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:42:56 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-ace9ff25-1e0d-4eb1-a012-6dbdba0e6dc0 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:42:56 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-ace9ff25-1e0d-4eb1-a012-6dbdba0e6dc0 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:42:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ace9ff25-1e0d-4eb1-a012-6dbdba0e6dc0 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ace9ff25-1e0d-4eb1-a012-6dbdba0e6dc0 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ace9ff25-1e0d-4eb1-a012-6dbdba0e6dc0 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ace9ff25-1e0d-4eb1-a012-6dbdba0e6dc0 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:42:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ace9ff25-1e0d-4eb1-a012-6dbdba0e6dc0 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:42:56 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-ace9ff25-1e0d-4eb1-a012-6dbdba0e6dc0 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:42:56 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-ace9ff25-1e0d-4eb1-a012-6dbdba0e6dc0 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:42:56 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-ace9ff25-1e0d-4eb1-a012-6dbdba0e6dc0 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53fa5a01-9d0a-480b-b1d3-028930c0e560" status: 200 len: 1439 microversion: 2.1 time: 0.169098 Apr 13 15:42:56 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 375/1134] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:42:56 2023] GET /compute/v2.1/servers/53fa5a01-9d0a-480b-b1d3-028930c0e560 => generated 1439 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:43:28 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:43:28 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:43:28 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-11c4ae77-994e-4ca5-8734-b77a7f10a072 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:43:28 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-11c4ae77-994e-4ca5-8734-b77a7f10a072 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:43:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-11c4ae77-994e-4ca5-8734-b77a7f10a072 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:43:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-11c4ae77-994e-4ca5-8734-b77a7f10a072 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:43:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-11c4ae77-994e-4ca5-8734-b77a7f10a072 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:43:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-11c4ae77-994e-4ca5-8734-b77a7f10a072 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:43:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-11c4ae77-994e-4ca5-8734-b77a7f10a072 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:43:28 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-11c4ae77-994e-4ca5-8734-b77a7f10a072 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:43:28 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-11c4ae77-994e-4ca5-8734-b77a7f10a072 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047238 Apr 13 15:43:28 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 380/1135] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 15:43:28 2023] GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 15:43:42 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:43:42 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:43:42 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-f51ddfb5-a7c8-4e38-897a-c0bc09f2ca2a req-2cdb2902-36c0-4006-a2f2-fe995afe790d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dccdbfbe-1261-490e-b8bf-b06e46d42f37", "tag": "bee671f2-48c8-41d0-945c-3c8b796aa286"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:43:42 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-f51ddfb5-a7c8-4e38-897a-c0bc09f2ca2a req-2cdb2902-36c0-4006-a2f2-fe995afe790d service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:43:42 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-f51ddfb5-a7c8-4e38-897a-c0bc09f2ca2a req-2cdb2902-36c0-4006-a2f2-fe995afe790d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:43:42 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-f51ddfb5-a7c8-4e38-897a-c0bc09f2ca2a req-2cdb2902-36c0-4006-a2f2-fe995afe790d service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:43:42 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-f51ddfb5-a7c8-4e38-897a-c0bc09f2ca2a req-2cdb2902-36c0-4006-a2f2-fe995afe790d service nova] Creating event network-changed:bee671f2-48c8-41d0-945c-3c8b796aa286 for instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 on user Apr 13 15:43:42 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-f51ddfb5-a7c8-4e38-897a-c0bc09f2ca2a req-2cdb2902-36c0-4006-a2f2-fe995afe790d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098357 Apr 13 15:43:42 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 381/1136] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:43:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:43:44 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:43:44 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:43:44 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:43:44 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:43:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:43:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:43:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:43:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:43:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:43:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:43:44 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Going to try to terminate instance {{(pid=61871) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:43:44 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37" status: 204 len: 0 microversion: 2.1 time: 0.144648 Apr 13 15:43:44 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 376/1137] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:43:44 2023] DELETE /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 13 15:43:44 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-3bcbb707-8244-4be5-b3bf-d0a18714b883 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:43:44 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-3bcbb707-8244-4be5-b3bf-d0a18714b883 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:43:44 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:43:44 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:43:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3bcbb707-8244-4be5-b3bf-d0a18714b883 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:43:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3bcbb707-8244-4be5-b3bf-d0a18714b883 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:43:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3bcbb707-8244-4be5-b3bf-d0a18714b883 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:43:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3bcbb707-8244-4be5-b3bf-d0a18714b883 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:43:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3bcbb707-8244-4be5-b3bf-d0a18714b883 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:43:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3bcbb707-8244-4be5-b3bf-d0a18714b883 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:43:45 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-5e911cf3-bb7b-4239-9985-7cc553321843 req-e7b52810-0a9f-4c26-939e-0af1efbdb643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dccdbfbe-1261-490e-b8bf-b06e46d42f37", "name": "network-vif-unplugged", "status": "completed", "tag": "bee671f2-48c8-41d0-945c-3c8b796aa286"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:43:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5e911cf3-bb7b-4239-9985-7cc553321843 req-e7b52810-0a9f-4c26-939e-0af1efbdb643 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:43:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5e911cf3-bb7b-4239-9985-7cc553321843 req-e7b52810-0a9f-4c26-939e-0af1efbdb643 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:43:45 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5e911cf3-bb7b-4239-9985-7cc553321843 req-e7b52810-0a9f-4c26-939e-0af1efbdb643 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:43:45 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-5e911cf3-bb7b-4239-9985-7cc553321843 req-e7b52810-0a9f-4c26-939e-0af1efbdb643 service nova] Creating event network-vif-unplugged:bee671f2-48c8-41d0-945c-3c8b796aa286 for instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 on user Apr 13 15:43:45 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-5e911cf3-bb7b-4239-9985-7cc553321843 req-e7b52810-0a9f-4c26-939e-0af1efbdb643 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035056 Apr 13 15:43:45 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 382/1138] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:43:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:43:45 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-3bcbb707-8244-4be5-b3bf-d0a18714b883 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0f7d9513b44bda8e53597cf7751ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc833ca51a84b6789f0def7357d4c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:43:45 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-3bcbb707-8244-4be5-b3bf-d0a18714b883 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37" status: 200 len: 1575 microversion: 2.1 time: 0.451276 Apr 13 15:43:45 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 381/1139] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:43:44 2023] GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37 => generated 1575 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:43:46 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-9fb1bb84-e5ad-4095-8d79-27fbe6f509c7 req-0066769d-db0f-4bd9-87bf-1aeec56af992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dccdbfbe-1261-490e-b8bf-b06e46d42f37", "name": "network-vif-deleted", "tag": "bee671f2-48c8-41d0-945c-3c8b796aa286"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:43:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-9fb1bb84-e5ad-4095-8d79-27fbe6f509c7 req-0066769d-db0f-4bd9-87bf-1aeec56af992 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:43:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-9fb1bb84-e5ad-4095-8d79-27fbe6f509c7 req-0066769d-db0f-4bd9-87bf-1aeec56af992 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:43:46 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-9fb1bb84-e5ad-4095-8d79-27fbe6f509c7 req-0066769d-db0f-4bd9-87bf-1aeec56af992 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:43:46 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-9fb1bb84-e5ad-4095-8d79-27fbe6f509c7 req-0066769d-db0f-4bd9-87bf-1aeec56af992 service nova] Creating event network-vif-deleted:bee671f2-48c8-41d0-945c-3c8b796aa286 for instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 on user Apr 13 15:43:46 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-9fb1bb84-e5ad-4095-8d79-27fbe6f509c7 req-0066769d-db0f-4bd9-87bf-1aeec56af992 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029231 Apr 13 15:43:46 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 377/1140] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:43:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:43:47 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-fe04582b-b44c-49fd-8db0-dc5211adf9e7 req-b0924286-a4ba-4191-a633-117cd9d03d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dccdbfbe-1261-490e-b8bf-b06e46d42f37", "name": "network-vif-plugged", "status": "completed", "tag": "bee671f2-48c8-41d0-945c-3c8b796aa286"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:43:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-fe04582b-b44c-49fd-8db0-dc5211adf9e7 req-b0924286-a4ba-4191-a633-117cd9d03d83 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:43:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-fe04582b-b44c-49fd-8db0-dc5211adf9e7 req-b0924286-a4ba-4191-a633-117cd9d03d83 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:43:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-fe04582b-b44c-49fd-8db0-dc5211adf9e7 req-b0924286-a4ba-4191-a633-117cd9d03d83 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:43:47 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-fe04582b-b44c-49fd-8db0-dc5211adf9e7 req-b0924286-a4ba-4191-a633-117cd9d03d83 service nova] Creating event network-vif-plugged:bee671f2-48c8-41d0-945c-3c8b796aa286 for instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 on user Apr 13 15:43:47 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-fe04582b-b44c-49fd-8db0-dc5211adf9e7 req-b0924286-a4ba-4191-a633-117cd9d03d83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030715 Apr 13 15:43:47 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 383/1141] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:43:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:43:56 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-80480007-00b7-47c9-b149-8412cb0ff732 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:43:56 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-80480007-00b7-47c9-b149-8412cb0ff732 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:43:56 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:43:56 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:43:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-80480007-00b7-47c9-b149-8412cb0ff732 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:43:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-80480007-00b7-47c9-b149-8412cb0ff732 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:43:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-80480007-00b7-47c9-b149-8412cb0ff732 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:43:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-80480007-00b7-47c9-b149-8412cb0ff732 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:43:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-80480007-00b7-47c9-b149-8412cb0ff732 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:43:56 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-80480007-00b7-47c9-b149-8412cb0ff732 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:43:56 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-80480007-00b7-47c9-b149-8412cb0ff732 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:43:56 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-80480007-00b7-47c9-b149-8412cb0ff732 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53fa5a01-9d0a-480b-b1d3-028930c0e560" status: 200 len: 1439 microversion: 2.1 time: 0.157041 Apr 13 15:43:56 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 382/1142] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:43:56 2023] GET /compute/v2.1/servers/53fa5a01-9d0a-480b-b1d3-028930c0e560 => generated 1439 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:43:58 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:43:58 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:43:58 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-ba6ac40c-a52d-4d39-b4cd-99429d3e5766 req-9ba41559-951c-41a3-a388-84f5372d24ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53fa5a01-9d0a-480b-b1d3-028930c0e560", "tag": "9fd4d123-8854-4643-8716-914a4c5694e3"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:43:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ba6ac40c-a52d-4d39-b4cd-99429d3e5766 req-9ba41559-951c-41a3-a388-84f5372d24ce service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:43:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ba6ac40c-a52d-4d39-b4cd-99429d3e5766 req-9ba41559-951c-41a3-a388-84f5372d24ce service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:43:58 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-ba6ac40c-a52d-4d39-b4cd-99429d3e5766 req-9ba41559-951c-41a3-a388-84f5372d24ce service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:43:58 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-ba6ac40c-a52d-4d39-b4cd-99429d3e5766 req-9ba41559-951c-41a3-a388-84f5372d24ce service nova] Creating event network-changed:9fd4d123-8854-4643-8716-914a4c5694e3 for instance 53fa5a01-9d0a-480b-b1d3-028930c0e560 on user Apr 13 15:43:58 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-ba6ac40c-a52d-4d39-b4cd-99429d3e5766 req-9ba41559-951c-41a3-a388-84f5372d24ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033464 Apr 13 15:43:58 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 378/1143] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:43:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:44:03 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:44:03 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:44:03 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1669921011", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-534201410", "security_groups": [{"name": "tempest-secgroup-smoke-945555796"}], "block_device_mapping_v2": [{"uuid": "29098607-080d-4a0e-afda-65df97acdffe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3"}]}} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:44:03 user devstack@n-api.service[61873]: DEBUG nova.network.neutron [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] validate_networks() for [('66ea8c1a-1c77-4a2a-ab35-64acac4762c3', None, None, None, None, None)] {{(pid=61873) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 15:44:04 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 15:44:04 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image limits 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 15:44:04 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 15:44:04 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image pref 0:0:0 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 15:44:04 user devstack@n-api.service[61873]: DEBUG nova.virt.hardware [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 15:44:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:44:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:44:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:44:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:44:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:44:04 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:44:04 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting quotas for project d5d7f771264c4cd2bc595a2c525082d0. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 15:44:04 user devstack@n-api.service[61873]: DEBUG nova.quota [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting quotas for user 0307fb8d127a41079e34355904352231 and project d5d7f771264c4cd2bc595a2c525082d0. Resources: {'cores', 'instances', 'ram'} {{(pid=61873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 15:44:04 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Going to run 1 instances... {{(pid=61873) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 15:44:04 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='29098607-080d-4a0e-afda-65df97acdffe',volume_size=None,volume_type=None)] {{(pid=61873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 15:44:04 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.892630 Apr 13 15:44:04 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 384/1144] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 15:44:03 2023] POST /compute/v2.1/servers => generated 403 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 15:44:04 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-d3aae2f4-7b5f-4bfa-8c28-54ca607383cd tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:44:04 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-d3aae2f4-7b5f-4bfa-8c28-54ca607383cd tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:44:04 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-d3aae2f4-7b5f-4bfa-8c28-54ca607383cd tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:44:04 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-d3aae2f4-7b5f-4bfa-8c28-54ca607383cd tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2745a5e-fef2-47ac-983d-dfd197fdf8c4" status: 200 len: 1089 microversion: 2.1 time: 0.066993 Apr 13 15:44:04 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 383/1145] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:44:04 2023] GET /compute/v2.1/servers/b2745a5e-fef2-47ac-983d-dfd197fdf8c4 => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:44:07 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-19cb758b-6fbf-417a-807d-b335179cc1b0 req-438818d5-bbcb-493a-8bc8-4d2744bbc6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2745a5e-fef2-47ac-983d-dfd197fdf8c4", "tag": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:44:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-19cb758b-6fbf-417a-807d-b335179cc1b0 req-438818d5-bbcb-493a-8bc8-4d2744bbc6e1 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:44:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-19cb758b-6fbf-417a-807d-b335179cc1b0 req-438818d5-bbcb-493a-8bc8-4d2744bbc6e1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:44:07 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-19cb758b-6fbf-417a-807d-b335179cc1b0 req-438818d5-bbcb-493a-8bc8-4d2744bbc6e1 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:44:07 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-19cb758b-6fbf-417a-807d-b335179cc1b0 req-438818d5-bbcb-493a-8bc8-4d2744bbc6e1 service nova] Creating event network-changed:a1c8b5ae-b836-48d3-b13f-5a13cfa72876 for instance b2745a5e-fef2-47ac-983d-dfd197fdf8c4 on user Apr 13 15:44:07 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-19cb758b-6fbf-417a-807d-b335179cc1b0 req-438818d5-bbcb-493a-8bc8-4d2744bbc6e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031621 Apr 13 15:44:07 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 379/1146] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:44:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:44:12 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-dd5ab840-d669-4ddf-89d4-bdcb73628d73 req-75a7e041-495f-4f44-b5c6-c5b43fd444b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2745a5e-fef2-47ac-983d-dfd197fdf8c4", "name": "network-vif-plugged", "status": "completed", "tag": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:44:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-dd5ab840-d669-4ddf-89d4-bdcb73628d73 req-75a7e041-495f-4f44-b5c6-c5b43fd444b9 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:44:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-dd5ab840-d669-4ddf-89d4-bdcb73628d73 req-75a7e041-495f-4f44-b5c6-c5b43fd444b9 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:44:12 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-dd5ab840-d669-4ddf-89d4-bdcb73628d73 req-75a7e041-495f-4f44-b5c6-c5b43fd444b9 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:44:12 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-dd5ab840-d669-4ddf-89d4-bdcb73628d73 req-75a7e041-495f-4f44-b5c6-c5b43fd444b9 service nova] Creating event network-vif-plugged:a1c8b5ae-b836-48d3-b13f-5a13cfa72876 for instance b2745a5e-fef2-47ac-983d-dfd197fdf8c4 on user Apr 13 15:44:12 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-dd5ab840-d669-4ddf-89d4-bdcb73628d73 req-75a7e041-495f-4f44-b5c6-c5b43fd444b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030810 Apr 13 15:44:12 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 385/1147] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:44:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:44:14 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-8c2b1e22-312e-4265-ad3e-e2711507db07 req-46169b0a-ac00-481e-9b9a-976d3e65d223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2745a5e-fef2-47ac-983d-dfd197fdf8c4", "name": "network-vif-plugged", "status": "completed", "tag": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:44:14 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:44:14 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:44:14 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell0:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:44:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-8c2b1e22-312e-4265-ad3e-e2711507db07 req-46169b0a-ac00-481e-9b9a-976d3e65d223 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:44:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-8c2b1e22-312e-4265-ad3e-e2711507db07 req-46169b0a-ac00-481e-9b9a-976d3e65d223 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:44:14 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-8c2b1e22-312e-4265-ad3e-e2711507db07 req-46169b0a-ac00-481e-9b9a-976d3e65d223 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:44:14 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-8c2b1e22-312e-4265-ad3e-e2711507db07 req-46169b0a-ac00-481e-9b9a-976d3e65d223 service nova] Creating event network-vif-plugged:a1c8b5ae-b836-48d3-b13f-5a13cfa72876 for instance b2745a5e-fef2-47ac-983d-dfd197fdf8c4 on user Apr 13 15:44:14 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-8c2b1e22-312e-4265-ad3e-e2711507db07 req-46169b0a-ac00-481e-9b9a-976d3e65d223 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034039 Apr 13 15:44:14 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 384/1148] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:44:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:44:35 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=4 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:44:35 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=4 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:44:35 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-18edbf96-c75f-4b3d-8cf4-f73b0a85f0ed tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:44:35 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-18edbf96-c75f-4b3d-8cf4-f73b0a85f0ed tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:44:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-18edbf96-c75f-4b3d-8cf4-f73b0a85f0ed tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:44:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-18edbf96-c75f-4b3d-8cf4-f73b0a85f0ed tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:44:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-18edbf96-c75f-4b3d-8cf4-f73b0a85f0ed tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:44:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-18edbf96-c75f-4b3d-8cf4-f73b0a85f0ed tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:44:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-18edbf96-c75f-4b3d-8cf4-f73b0a85f0ed tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:44:35 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-18edbf96-c75f-4b3d-8cf4-f73b0a85f0ed tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:44:35 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-18edbf96-c75f-4b3d-8cf4-f73b0a85f0ed tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] HTTP exception thrown: Instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 could not be found. Apr 13 15:44:35 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-18edbf96-c75f-4b3d-8cf4-f73b0a85f0ed tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Request method failure captured: Apr 13 15:44:35 user devstack@n-api.service[61871]: request: GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37 HTTP/1.1 Apr 13 15:44:35 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:44:35 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:44:35 user devstack@n-api.service[61871]: Connection: close Apr 13 15:44:35 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:44:35 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:44:35 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:44:35 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:44:35 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:44:35 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOCGlsgwl-uNLmAabty7OJuXArzy7srjLohQubjZDfUoGye_raMGIqocMEKzdvUlh_nlQvAbbuoUaGhhKU67xFGfWSQO5Q4HVrxf8gAuZPJBc0w8OqKKa3P7YVV7tM2OcRmwXzDSC6xdtuWrvPyDIKhXhHMItgRkBLgS5zFRoUjMTjDQ Apr 13 15:44:35 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:44:35 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:44:35 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:44:35 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:44:35 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:44:35 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:44:35 user devstack@n-api.service[61871]: X-Project-Id: 3fc833ca51a84b6789f0def7357d4c59 Apr 13 15:44:35 user devstack@n-api.service[61871]: X-Project-Name: tempest-SnapshotDataIntegrityTests-965824759 Apr 13 15:44:35 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:44:35 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:44:35 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3fc833ca51a84b6789f0def7357d4c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3fc833ca51a84b6789f0def7357d4c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3fc833ca51a84b6789f0def7357d4c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:44:35 user devstack@n-api.service[61871]: X-Tenant: tempest-SnapshotDataIntegrityTests-965824759 Apr 13 15:44:35 user devstack@n-api.service[61871]: X-Tenant-Id: 3fc833ca51a84b6789f0def7357d4c59 Apr 13 15:44:35 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-965824759 Apr 13 15:44:35 user devstack@n-api.service[61871]: X-User: tempest-SnapshotDataIntegrityTests-965824759-project-member Apr 13 15:44:35 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:44:35 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:44:35 user devstack@n-api.service[61871]: X-User-Id: af0f7d9513b44bda8e53597cf7751ec0 Apr 13 15:44:35 user devstack@n-api.service[61871]: X-User-Name: tempest-SnapshotDataIntegrityTests-965824759-project-member Apr 13 15:44:35 user devstack@n-api.service[61871]: method: > Apr 13 15:44:35 user devstack@n-api.service[61871]: exception: Instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 could not be found. Apr 13 15:44:35 user devstack@n-api.service[61871]: action_args: {'id': 'dccdbfbe-1261-490e-b8bf-b06e46d42f37'} Apr 13 15:44:35 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 could not be found. Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 could not be found. Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 could not be found. Apr 13 15:44:35 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:44:35 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-18edbf96-c75f-4b3d-8cf4-f73b0a85f0ed tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Returning 404 to user: Instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:44:35 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-18edbf96-c75f-4b3d-8cf4-f73b0a85f0ed tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37" status: 404 len: 111 microversion: 2.1 time: 0.032812 Apr 13 15:44:35 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 380/1149] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:44:35 2023] GET /compute/v2.1/servers/dccdbfbe-1261-490e-b8bf-b06e46d42f37 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:44:35 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=2 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:44:35 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell0:SELECT=6 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:44:35 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:44:35 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:44:35 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-42df17bd-c4ee-4d4c-92d6-6a3f5ba0ca96 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Calling method '.version_select at 0x7f3a8b7c2710>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:44:35 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-42df17bd-c4ee-4d4c-92d6-6a3f5ba0ca96 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1169680877" status: 202 len: 0 microversion: 2.1 time: 0.034579 Apr 13 15:44:35 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 386/1150] 10.0.0.210 () {62 vars in 1355 bytes} [Thu Apr 13 15:44:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1169680877 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 15:44:54 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:44:54 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:44:54 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-b55639b1-e447-42d2-bfb8-ad69f611e0c8 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:44:54 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-b55639b1-e447-42d2-bfb8-ad69f611e0c8 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:44:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b55639b1-e447-42d2-bfb8-ad69f611e0c8 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:44:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b55639b1-e447-42d2-bfb8-ad69f611e0c8 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:44:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b55639b1-e447-42d2-bfb8-ad69f611e0c8 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:44:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b55639b1-e447-42d2-bfb8-ad69f611e0c8 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:44:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b55639b1-e447-42d2-bfb8-ad69f611e0c8 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:44:54 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-b55639b1-e447-42d2-bfb8-ad69f611e0c8 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:44:54 user devstack@n-api.service[61872]: DEBUG nova.policy [None req-b55639b1-e447-42d2-bfb8-ad69f611e0c8 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61872) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:44:54 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-b55639b1-e447-42d2-bfb8-ad69f611e0c8 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2745a5e-fef2-47ac-983d-dfd197fdf8c4" status: 200 len: 1441 microversion: 2.1 time: 0.176598 Apr 13 15:44:54 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 385/1151] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:44:54 2023] GET /compute/v2.1/servers/b2745a5e-fef2-47ac-983d-dfd197fdf8c4 => generated 1441 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:45:54 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:45:54 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=2 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:45:54 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-5a8d40a5-79aa-4931-af60-8674fd101884 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:45:54 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-5a8d40a5-79aa-4931-af60-8674fd101884 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:45:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5a8d40a5-79aa-4931-af60-8674fd101884 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:45:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5a8d40a5-79aa-4931-af60-8674fd101884 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:45:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5a8d40a5-79aa-4931-af60-8674fd101884 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:45:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5a8d40a5-79aa-4931-af60-8674fd101884 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:45:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5a8d40a5-79aa-4931-af60-8674fd101884 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:45:54 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-5a8d40a5-79aa-4931-af60-8674fd101884 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:45:55 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-5a8d40a5-79aa-4931-af60-8674fd101884 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:45:55 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-5a8d40a5-79aa-4931-af60-8674fd101884 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2745a5e-fef2-47ac-983d-dfd197fdf8c4" status: 200 len: 1441 microversion: 2.1 time: 0.452945 Apr 13 15:45:55 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 381/1152] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:45:54 2023] GET /compute/v2.1/servers/b2745a5e-fef2-47ac-983d-dfd197fdf8c4 => generated 1441 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:45:56 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:45:56 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-f0aa390c-f636-47b3-8bf9-8aae69052f4d req-d854b017-0086-49cb-aa90-9291db128fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2745a5e-fef2-47ac-983d-dfd197fdf8c4", "tag": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:45:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-f0aa390c-f636-47b3-8bf9-8aae69052f4d req-d854b017-0086-49cb-aa90-9291db128fc3 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:45:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-f0aa390c-f636-47b3-8bf9-8aae69052f4d req-d854b017-0086-49cb-aa90-9291db128fc3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:45:56 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-f0aa390c-f636-47b3-8bf9-8aae69052f4d req-d854b017-0086-49cb-aa90-9291db128fc3 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:45:56 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-f0aa390c-f636-47b3-8bf9-8aae69052f4d req-d854b017-0086-49cb-aa90-9291db128fc3 service nova] Creating event network-changed:a1c8b5ae-b836-48d3-b13f-5a13cfa72876 for instance b2745a5e-fef2-47ac-983d-dfd197fdf8c4 on user Apr 13 15:45:56 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-f0aa390c-f636-47b3-8bf9-8aae69052f4d req-d854b017-0086-49cb-aa90-9291db128fc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183333 Apr 13 15:45:56 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 387/1153] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:45:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:45:57 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=2 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:45:57 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=6 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:45:57 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:45:57 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:45:57 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:45:57 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:45:57 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:45:57 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:45:57 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:45:57 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:45:57 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Going to try to terminate instance {{(pid=61872) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:45:57 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b2745a5e-fef2-47ac-983d-dfd197fdf8c4" status: 204 len: 0 microversion: 2.1 time: 0.114125 Apr 13 15:45:57 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 386/1154] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:45:57 2023] DELETE /compute/v2.1/servers/b2745a5e-fef2-47ac-983d-dfd197fdf8c4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:45:57 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-f21fbcce-3a71-4b4b-a8db-6f41d5871697 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:45:57 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-f21fbcce-3a71-4b4b-a8db-6f41d5871697 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:45:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f21fbcce-3a71-4b4b-a8db-6f41d5871697 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:45:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f21fbcce-3a71-4b4b-a8db-6f41d5871697 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:45:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f21fbcce-3a71-4b4b-a8db-6f41d5871697 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:45:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f21fbcce-3a71-4b4b-a8db-6f41d5871697 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:45:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f21fbcce-3a71-4b4b-a8db-6f41d5871697 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:45:57 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-f21fbcce-3a71-4b4b-a8db-6f41d5871697 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:45:57 user devstack@n-api.service[61871]: DEBUG nova.policy [None req-f21fbcce-3a71-4b4b-a8db-6f41d5871697 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61871) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:45:57 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-f21fbcce-3a71-4b4b-a8db-6f41d5871697 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2745a5e-fef2-47ac-983d-dfd197fdf8c4" status: 200 len: 1447 microversion: 2.1 time: 0.152339 Apr 13 15:45:57 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 382/1155] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:45:57 2023] GET /compute/v2.1/servers/b2745a5e-fef2-47ac-983d-dfd197fdf8c4 => generated 1447 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:45:57 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [req-5f9f1d45-45ed-4544-b845-219d690b63b6 req-c74c28cd-fec4-4f2e-801e-fb4b030f0fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2745a5e-fef2-47ac-983d-dfd197fdf8c4", "name": "network-vif-unplugged", "status": "completed", "tag": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876"}]} {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:45:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5f9f1d45-45ed-4544-b845-219d690b63b6 req-c74c28cd-fec4-4f2e-801e-fb4b030f0fe7 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:45:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5f9f1d45-45ed-4544-b845-219d690b63b6 req-c74c28cd-fec4-4f2e-801e-fb4b030f0fe7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:45:57 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [req-5f9f1d45-45ed-4544-b845-219d690b63b6 req-c74c28cd-fec4-4f2e-801e-fb4b030f0fe7 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:45:57 user devstack@n-api.service[61873]: INFO nova.api.openstack.compute.server_external_events [req-5f9f1d45-45ed-4544-b845-219d690b63b6 req-c74c28cd-fec4-4f2e-801e-fb4b030f0fe7 service nova] Creating event network-vif-unplugged:a1c8b5ae-b836-48d3-b13f-5a13cfa72876 for instance b2745a5e-fef2-47ac-983d-dfd197fdf8c4 on user Apr 13 15:45:57 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [req-5f9f1d45-45ed-4544-b845-219d690b63b6 req-c74c28cd-fec4-4f2e-801e-fb4b030f0fe7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087366 Apr 13 15:45:57 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 388/1156] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:45:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:45:58 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-ad6314c0-7be5-4171-8778-95489be6a17f req-59f5f20a-bff7-4a57-b062-0b203aeac6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2745a5e-fef2-47ac-983d-dfd197fdf8c4", "tag": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:45:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-ad6314c0-7be5-4171-8778-95489be6a17f req-59f5f20a-bff7-4a57-b062-0b203aeac6f5 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:45:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-ad6314c0-7be5-4171-8778-95489be6a17f req-59f5f20a-bff7-4a57-b062-0b203aeac6f5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:45:58 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-ad6314c0-7be5-4171-8778-95489be6a17f req-59f5f20a-bff7-4a57-b062-0b203aeac6f5 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:45:58 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-ad6314c0-7be5-4171-8778-95489be6a17f req-59f5f20a-bff7-4a57-b062-0b203aeac6f5 service nova] Creating event network-changed:a1c8b5ae-b836-48d3-b13f-5a13cfa72876 for instance b2745a5e-fef2-47ac-983d-dfd197fdf8c4 on user Apr 13 15:45:58 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-ad6314c0-7be5-4171-8778-95489be6a17f req-59f5f20a-bff7-4a57-b062-0b203aeac6f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031388 Apr 13 15:45:58 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 387/1157] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:45:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:45:59 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-e5771e1e-4177-413e-9197-c911b1a88262 req-23a38f9d-012a-4227-bc86-de13b2473db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2745a5e-fef2-47ac-983d-dfd197fdf8c4", "name": "network-vif-plugged", "status": "completed", "tag": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876"}, {"server_uuid": "b2745a5e-fef2-47ac-983d-dfd197fdf8c4", "name": "network-vif-deleted", "tag": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:45:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-e5771e1e-4177-413e-9197-c911b1a88262 req-23a38f9d-012a-4227-bc86-de13b2473db4 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:45:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-e5771e1e-4177-413e-9197-c911b1a88262 req-23a38f9d-012a-4227-bc86-de13b2473db4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:45:59 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-e5771e1e-4177-413e-9197-c911b1a88262 req-23a38f9d-012a-4227-bc86-de13b2473db4 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:45:59 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-e5771e1e-4177-413e-9197-c911b1a88262 req-23a38f9d-012a-4227-bc86-de13b2473db4 service nova] Creating event network-vif-plugged:a1c8b5ae-b836-48d3-b13f-5a13cfa72876 for instance b2745a5e-fef2-47ac-983d-dfd197fdf8c4 on user Apr 13 15:45:59 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-e5771e1e-4177-413e-9197-c911b1a88262 req-23a38f9d-012a-4227-bc86-de13b2473db4 service nova] Creating event network-vif-deleted:a1c8b5ae-b836-48d3-b13f-5a13cfa72876 for instance b2745a5e-fef2-47ac-983d-dfd197fdf8c4 on user Apr 13 15:45:59 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-e5771e1e-4177-413e-9197-c911b1a88262 req-23a38f9d-012a-4227-bc86-de13b2473db4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033879 Apr 13 15:45:59 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 383/1158] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:45:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:46:47 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:46:47 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:46:47 user devstack@n-api.service[61873]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 13 15:46:47 user devstack@n-api.service[61873]: Thu Apr 13 15:46:47 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2745a5e-fef2-47ac-983d-dfd197fdf8c4 (ip 10.0.0.210) !!! Apr 13 15:46:47 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7706ba63-f350-4566-a7de-e195b2245bdd tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:46:47 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-7706ba63-f350-4566-a7de-e195b2245bdd tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:46:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7706ba63-f350-4566-a7de-e195b2245bdd tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:46:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7706ba63-f350-4566-a7de-e195b2245bdd tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:46:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7706ba63-f350-4566-a7de-e195b2245bdd tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:46:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7706ba63-f350-4566-a7de-e195b2245bdd tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:46:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7706ba63-f350-4566-a7de-e195b2245bdd tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:46:47 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-7706ba63-f350-4566-a7de-e195b2245bdd tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:46:47 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-7706ba63-f350-4566-a7de-e195b2245bdd tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HTTP exception thrown: Instance b2745a5e-fef2-47ac-983d-dfd197fdf8c4 could not be found. Apr 13 15:46:47 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7706ba63-f350-4566-a7de-e195b2245bdd tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Request method failure captured: Apr 13 15:46:47 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/b2745a5e-fef2-47ac-983d-dfd197fdf8c4 HTTP/1.1 Apr 13 15:46:47 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:46:47 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:46:47 user devstack@n-api.service[61873]: Connection: close Apr 13 15:46:47 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:46:47 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:46:47 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:46:47 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:46:47 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:46:47 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOCAkop2IkGDfTg_hLFhCzVF0r-Snnfp8mpD-rNTz3fSyNRaGCKUvuIX-bvQSQt24XSPbyAQXj1tiZH1C9TwK7awcWO7BHnx8xBG9YOZB63Dpng-DDIXtPRCA4OT9QRrpOESCL1mwTOYQNnj8ZeocbvX0wE2u-g1UjUjvIIUGz4v71K0 Apr 13 15:46:47 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:46:47 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:46:47 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:46:47 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:46:47 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:46:47 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:46:47 user devstack@n-api.service[61873]: X-Project-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:46:47 user devstack@n-api.service[61873]: X-Project-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:46:47 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:46:47 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:46:47 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:46:47 user devstack@n-api.service[61873]: X-Tenant: tempest-TestVolumeBootPattern-374778702 Apr 13 15:46:47 user devstack@n-api.service[61873]: X-Tenant-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:46:47 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:46:47 user devstack@n-api.service[61873]: X-User: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:46:47 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:46:47 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:46:47 user devstack@n-api.service[61873]: X-User-Id: 0307fb8d127a41079e34355904352231 Apr 13 15:46:47 user devstack@n-api.service[61873]: X-User-Name: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:46:47 user devstack@n-api.service[61873]: method: > Apr 13 15:46:47 user devstack@n-api.service[61873]: exception: Instance b2745a5e-fef2-47ac-983d-dfd197fdf8c4 could not be found. Apr 13 15:46:47 user devstack@n-api.service[61873]: action_args: {'id': 'b2745a5e-fef2-47ac-983d-dfd197fdf8c4'} Apr 13 15:46:47 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2745a5e-fef2-47ac-983d-dfd197fdf8c4 could not be found. Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2745a5e-fef2-47ac-983d-dfd197fdf8c4 could not be found. Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2745a5e-fef2-47ac-983d-dfd197fdf8c4 could not be found. Apr 13 15:46:47 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:46:47 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-7706ba63-f350-4566-a7de-e195b2245bdd tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Returning 404 to user: Instance b2745a5e-fef2-47ac-983d-dfd197fdf8c4 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:46:47 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-7706ba63-f350-4566-a7de-e195b2245bdd tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2745a5e-fef2-47ac-983d-dfd197fdf8c4" status: 404 len: 111 microversion: 2.1 time: 0.148801 Apr 13 15:46:47 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 389/1159] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:46:47 2023] GET /compute/v2.1/servers/b2745a5e-fef2-47ac-983d-dfd197fdf8c4 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:46:52 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:46:52 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:46:52 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=6 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:46:52 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=14 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:46:52 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:46:52 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:46:52 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-665c6350-a504-4527-a380-1476a0e1183a req-84e760f2-8d97-4a6d-848a-5b75606b3ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53fa5a01-9d0a-480b-b1d3-028930c0e560", "tag": "9fd4d123-8854-4643-8716-914a4c5694e3"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:46:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:46:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:46:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:46:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:46:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:46:52 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:46:52 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-665c6350-a504-4527-a380-1476a0e1183a req-84e760f2-8d97-4a6d-848a-5b75606b3ee9 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:46:52 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-665c6350-a504-4527-a380-1476a0e1183a req-84e760f2-8d97-4a6d-848a-5b75606b3ee9 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:46:52 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-665c6350-a504-4527-a380-1476a0e1183a req-84e760f2-8d97-4a6d-848a-5b75606b3ee9 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:46:52 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-665c6350-a504-4527-a380-1476a0e1183a req-84e760f2-8d97-4a6d-848a-5b75606b3ee9 service nova] Creating event network-changed:9fd4d123-8854-4643-8716-914a4c5694e3 for instance 53fa5a01-9d0a-480b-b1d3-028930c0e560 on user Apr 13 15:46:52 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Going to try to terminate instance {{(pid=61872) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 15:46:52 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-665c6350-a504-4527-a380-1476a0e1183a req-84e760f2-8d97-4a6d-848a-5b75606b3ee9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042872 Apr 13 15:46:52 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 384/1160] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:46:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:46:52 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/53fa5a01-9d0a-480b-b1d3-028930c0e560" status: 204 len: 0 microversion: 2.1 time: 0.115901 Apr 13 15:46:52 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 388/1161] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:46:52 2023] DELETE /compute/v2.1/servers/53fa5a01-9d0a-480b-b1d3-028930c0e560 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 15:46:52 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-af58a12a-19c2-4259-a73a-2cb6d307cbfb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:46:52 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-af58a12a-19c2-4259-a73a-2cb6d307cbfb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:46:52 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-af58a12a-19c2-4259-a73a-2cb6d307cbfb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:46:52 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-af58a12a-19c2-4259-a73a-2cb6d307cbfb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:46:52 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-af58a12a-19c2-4259-a73a-2cb6d307cbfb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:46:52 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-af58a12a-19c2-4259-a73a-2cb6d307cbfb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:46:52 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-af58a12a-19c2-4259-a73a-2cb6d307cbfb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:46:52 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-af58a12a-19c2-4259-a73a-2cb6d307cbfb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:46:53 user devstack@n-api.service[61873]: DEBUG nova.policy [None req-af58a12a-19c2-4259-a73a-2cb6d307cbfb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61873) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 15:46:53 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-af58a12a-19c2-4259-a73a-2cb6d307cbfb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53fa5a01-9d0a-480b-b1d3-028930c0e560" status: 200 len: 1564 microversion: 2.1 time: 0.330014 Apr 13 15:46:53 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 390/1162] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:46:52 2023] GET /compute/v2.1/servers/53fa5a01-9d0a-480b-b1d3-028930c0e560 => generated 1564 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 15:46:53 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [req-09017cd2-8a30-4c63-8fcd-1f9194edc845 req-b56bb29e-e67d-4977-bb6f-edd77c71710c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53fa5a01-9d0a-480b-b1d3-028930c0e560", "name": "network-vif-unplugged", "status": "completed", "tag": "9fd4d123-8854-4643-8716-914a4c5694e3"}]} {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:46:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-09017cd2-8a30-4c63-8fcd-1f9194edc845 req-b56bb29e-e67d-4977-bb6f-edd77c71710c service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:46:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-09017cd2-8a30-4c63-8fcd-1f9194edc845 req-b56bb29e-e67d-4977-bb6f-edd77c71710c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:46:53 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [req-09017cd2-8a30-4c63-8fcd-1f9194edc845 req-b56bb29e-e67d-4977-bb6f-edd77c71710c service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:46:53 user devstack@n-api.service[61871]: INFO nova.api.openstack.compute.server_external_events [req-09017cd2-8a30-4c63-8fcd-1f9194edc845 req-b56bb29e-e67d-4977-bb6f-edd77c71710c service nova] Creating event network-vif-unplugged:9fd4d123-8854-4643-8716-914a4c5694e3 for instance 53fa5a01-9d0a-480b-b1d3-028930c0e560 on user Apr 13 15:46:53 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [req-09017cd2-8a30-4c63-8fcd-1f9194edc845 req-b56bb29e-e67d-4977-bb6f-edd77c71710c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083621 Apr 13 15:46:53 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 385/1163] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:46:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:46:55 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [req-0421b02b-9a12-4976-8b64-9a54da4ff839 req-6446bf39-b29c-4440-aa92-4cbe2e51a387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53fa5a01-9d0a-480b-b1d3-028930c0e560", "name": "network-vif-plugged", "status": "completed", "tag": "9fd4d123-8854-4643-8716-914a4c5694e3"}, {"server_uuid": "53fa5a01-9d0a-480b-b1d3-028930c0e560", "name": "network-vif-deleted", "tag": "9fd4d123-8854-4643-8716-914a4c5694e3"}]} {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 15:46:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-0421b02b-9a12-4976-8b64-9a54da4ff839 req-6446bf39-b29c-4440-aa92-4cbe2e51a387 service nova] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:46:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-0421b02b-9a12-4976-8b64-9a54da4ff839 req-6446bf39-b29c-4440-aa92-4cbe2e51a387 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:46:55 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [req-0421b02b-9a12-4976-8b64-9a54da4ff839 req-6446bf39-b29c-4440-aa92-4cbe2e51a387 service nova] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:46:55 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-0421b02b-9a12-4976-8b64-9a54da4ff839 req-6446bf39-b29c-4440-aa92-4cbe2e51a387 service nova] Creating event network-vif-plugged:9fd4d123-8854-4643-8716-914a4c5694e3 for instance 53fa5a01-9d0a-480b-b1d3-028930c0e560 on user Apr 13 15:46:55 user devstack@n-api.service[61872]: INFO nova.api.openstack.compute.server_external_events [req-0421b02b-9a12-4976-8b64-9a54da4ff839 req-6446bf39-b29c-4440-aa92-4cbe2e51a387 service nova] Creating event network-vif-deleted:9fd4d123-8854-4643-8716-914a4c5694e3 for instance 53fa5a01-9d0a-480b-b1d3-028930c0e560 on user Apr 13 15:46:55 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [req-0421b02b-9a12-4976-8b64-9a54da4ff839 req-6446bf39-b29c-4440-aa92-4cbe2e51a387 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029682 Apr 13 15:46:55 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 389/1164] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 15:46:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 15:47:43 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-1a1e4fea-84f5-4593-9d53-36a7646d5a57 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:47:43 user devstack@n-api.service[61873]: DEBUG nova.compute.api [None req-1a1e4fea-84f5-4593-9d53-36a7646d5a57 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Fetching instance by UUID {{(pid=61873) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:47:43 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_api:SELECT=4 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:47:43 user devstack@n-api.service[61873]: DEBUG dbcounter [-] [61873] Writing DB stats nova_cell1:SELECT=8 {{(pid=61873) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:47:43 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1a1e4fea-84f5-4593-9d53-36a7646d5a57 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:47:43 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1a1e4fea-84f5-4593-9d53-36a7646d5a57 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:47:43 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1a1e4fea-84f5-4593-9d53-36a7646d5a57 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:47:43 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1a1e4fea-84f5-4593-9d53-36a7646d5a57 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:47:43 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1a1e4fea-84f5-4593-9d53-36a7646d5a57 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:47:43 user devstack@n-api.service[61873]: DEBUG oslo_concurrency.lockutils [None req-1a1e4fea-84f5-4593-9d53-36a7646d5a57 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61873) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:47:43 user devstack@n-api.service[61873]: INFO nova.api.openstack.wsgi [None req-1a1e4fea-84f5-4593-9d53-36a7646d5a57 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HTTP exception thrown: Instance 53fa5a01-9d0a-480b-b1d3-028930c0e560 could not be found. Apr 13 15:47:43 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-1a1e4fea-84f5-4593-9d53-36a7646d5a57 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Request method failure captured: Apr 13 15:47:43 user devstack@n-api.service[61873]: request: GET /compute/v2.1/servers/53fa5a01-9d0a-480b-b1d3-028930c0e560 HTTP/1.1 Apr 13 15:47:43 user devstack@n-api.service[61873]: Accept: application/json Apr 13 15:47:43 user devstack@n-api.service[61873]: Accept-Encoding: identity Apr 13 15:47:43 user devstack@n-api.service[61873]: Connection: close Apr 13 15:47:43 user devstack@n-api.service[61873]: Content-Length: 0 Apr 13 15:47:43 user devstack@n-api.service[61873]: Content-Type: application/json Apr 13 15:47:43 user devstack@n-api.service[61873]: Host: 10.0.0.210 Apr 13 15:47:43 user devstack@n-api.service[61873]: Openstack-System-Scope: None Apr 13 15:47:43 user devstack@n-api.service[61873]: User-Agent: python-urllib3/1.26.15 Apr 13 15:47:43 user devstack@n-api.service[61873]: X-Auth-Token: gAAAAABkOCAkop2IkGDfTg_hLFhCzVF0r-Snnfp8mpD-rNTz3fSyNRaGCKUvuIX-bvQSQt24XSPbyAQXj1tiZH1C9TwK7awcWO7BHnx8xBG9YOZB63Dpng-DDIXtPRCA4OT9QRrpOESCL1mwTOYQNnj8ZeocbvX0wE2u-g1UjUjvIIUGz4v71K0 Apr 13 15:47:43 user devstack@n-api.service[61873]: X-Domain-Id: None Apr 13 15:47:43 user devstack@n-api.service[61873]: X-Domain-Name: None Apr 13 15:47:43 user devstack@n-api.service[61873]: X-Identity-Status: Confirmed Apr 13 15:47:43 user devstack@n-api.service[61873]: X-Is-Admin-Project: True Apr 13 15:47:43 user devstack@n-api.service[61873]: X-Project-Domain-Id: default Apr 13 15:47:43 user devstack@n-api.service[61873]: X-Project-Domain-Name: Default Apr 13 15:47:43 user devstack@n-api.service[61873]: X-Project-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:47:43 user devstack@n-api.service[61873]: X-Project-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:47:43 user devstack@n-api.service[61873]: X-Role: member,reader Apr 13 15:47:43 user devstack@n-api.service[61873]: X-Roles: member,reader Apr 13 15:47:43 user devstack@n-api.service[61873]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:47:43 user devstack@n-api.service[61873]: X-Tenant: tempest-TestVolumeBootPattern-374778702 Apr 13 15:47:43 user devstack@n-api.service[61873]: X-Tenant-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:47:43 user devstack@n-api.service[61873]: X-Tenant-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:47:43 user devstack@n-api.service[61873]: X-User: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:47:43 user devstack@n-api.service[61873]: X-User-Domain-Id: default Apr 13 15:47:43 user devstack@n-api.service[61873]: X-User-Domain-Name: Default Apr 13 15:47:43 user devstack@n-api.service[61873]: X-User-Id: 0307fb8d127a41079e34355904352231 Apr 13 15:47:43 user devstack@n-api.service[61873]: X-User-Name: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:47:43 user devstack@n-api.service[61873]: method: > Apr 13 15:47:43 user devstack@n-api.service[61873]: exception: Instance 53fa5a01-9d0a-480b-b1d3-028930c0e560 could not be found. Apr 13 15:47:43 user devstack@n-api.service[61873]: action_args: {'id': '53fa5a01-9d0a-480b-b1d3-028930c0e560'} Apr 13 15:47:43 user devstack@n-api.service[61873]: {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53fa5a01-9d0a-480b-b1d3-028930c0e560 could not be found. Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53fa5a01-9d0a-480b-b1d3-028930c0e560 could not be found. Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53fa5a01-9d0a-480b-b1d3-028930c0e560 could not be found. Apr 13 15:47:43 user devstack@n-api.service[61873]: ERROR nova.api.openstack.wsgi Apr 13 15:47:43 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-1a1e4fea-84f5-4593-9d53-36a7646d5a57 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Returning 404 to user: Instance 53fa5a01-9d0a-480b-b1d3-028930c0e560 could not be found. {{(pid=61873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:47:43 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-1a1e4fea-84f5-4593-9d53-36a7646d5a57 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53fa5a01-9d0a-480b-b1d3-028930c0e560" status: 404 len: 111 microversion: 2.1 time: 0.034874 Apr 13 15:47:43 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 391/1165] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:47:43 2023] GET /compute/v2.1/servers/53fa5a01-9d0a-480b-b1d3-028930c0e560 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:47:44 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_api:SELECT=4 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:47:44 user devstack@n-api.service[61871]: DEBUG dbcounter [-] [61871] Writing DB stats nova_cell1:SELECT=4 {{(pid=61871) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:47:44 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-7790d38f-aa1e-4ccd-b751-3238beaa2334 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:47:44 user devstack@n-api.service[61871]: DEBUG nova.compute.api [None req-7790d38f-aa1e-4ccd-b751-3238beaa2334 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Fetching instance by UUID {{(pid=61871) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:47:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7790d38f-aa1e-4ccd-b751-3238beaa2334 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:47:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7790d38f-aa1e-4ccd-b751-3238beaa2334 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:47:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7790d38f-aa1e-4ccd-b751-3238beaa2334 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:47:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7790d38f-aa1e-4ccd-b751-3238beaa2334 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:47:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7790d38f-aa1e-4ccd-b751-3238beaa2334 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:47:44 user devstack@n-api.service[61871]: DEBUG oslo_concurrency.lockutils [None req-7790d38f-aa1e-4ccd-b751-3238beaa2334 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61871) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:47:44 user devstack@n-api.service[61871]: INFO nova.api.openstack.wsgi [None req-7790d38f-aa1e-4ccd-b751-3238beaa2334 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HTTP exception thrown: Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 could not be found. Apr 13 15:47:44 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-7790d38f-aa1e-4ccd-b751-3238beaa2334 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Request method failure captured: Apr 13 15:47:44 user devstack@n-api.service[61871]: request: DELETE /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12 HTTP/1.1 Apr 13 15:47:44 user devstack@n-api.service[61871]: Accept: application/json Apr 13 15:47:44 user devstack@n-api.service[61871]: Accept-Encoding: identity Apr 13 15:47:44 user devstack@n-api.service[61871]: Connection: close Apr 13 15:47:44 user devstack@n-api.service[61871]: Content-Length: 0 Apr 13 15:47:44 user devstack@n-api.service[61871]: Content-Type: application/json Apr 13 15:47:44 user devstack@n-api.service[61871]: Host: 10.0.0.210 Apr 13 15:47:44 user devstack@n-api.service[61871]: Openstack-System-Scope: None Apr 13 15:47:44 user devstack@n-api.service[61871]: User-Agent: python-urllib3/1.26.15 Apr 13 15:47:44 user devstack@n-api.service[61871]: X-Auth-Token: gAAAAABkOCAkop2IkGDfTg_hLFhCzVF0r-Snnfp8mpD-rNTz3fSyNRaGCKUvuIX-bvQSQt24XSPbyAQXj1tiZH1C9TwK7awcWO7BHnx8xBG9YOZB63Dpng-DDIXtPRCA4OT9QRrpOESCL1mwTOYQNnj8ZeocbvX0wE2u-g1UjUjvIIUGz4v71K0 Apr 13 15:47:44 user devstack@n-api.service[61871]: X-Domain-Id: None Apr 13 15:47:44 user devstack@n-api.service[61871]: X-Domain-Name: None Apr 13 15:47:44 user devstack@n-api.service[61871]: X-Identity-Status: Confirmed Apr 13 15:47:44 user devstack@n-api.service[61871]: X-Is-Admin-Project: True Apr 13 15:47:44 user devstack@n-api.service[61871]: X-Project-Domain-Id: default Apr 13 15:47:44 user devstack@n-api.service[61871]: X-Project-Domain-Name: Default Apr 13 15:47:44 user devstack@n-api.service[61871]: X-Project-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:47:44 user devstack@n-api.service[61871]: X-Project-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:47:44 user devstack@n-api.service[61871]: X-Role: member,reader Apr 13 15:47:44 user devstack@n-api.service[61871]: X-Roles: member,reader Apr 13 15:47:44 user devstack@n-api.service[61871]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:47:44 user devstack@n-api.service[61871]: X-Tenant: tempest-TestVolumeBootPattern-374778702 Apr 13 15:47:44 user devstack@n-api.service[61871]: X-Tenant-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:47:44 user devstack@n-api.service[61871]: X-Tenant-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:47:44 user devstack@n-api.service[61871]: X-User: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:47:44 user devstack@n-api.service[61871]: X-User-Domain-Id: default Apr 13 15:47:44 user devstack@n-api.service[61871]: X-User-Domain-Name: Default Apr 13 15:47:44 user devstack@n-api.service[61871]: X-User-Id: 0307fb8d127a41079e34355904352231 Apr 13 15:47:44 user devstack@n-api.service[61871]: X-User-Name: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:47:44 user devstack@n-api.service[61871]: method: > Apr 13 15:47:44 user devstack@n-api.service[61871]: exception: Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 could not be found. Apr 13 15:47:44 user devstack@n-api.service[61871]: action_args: {'id': '4a17bf49-ffae-4178-b484-6c45bd80fb12'} Apr 13 15:47:44 user devstack@n-api.service[61871]: {{(pid=61871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 could not be found. Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 could not be found. Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 could not be found. Apr 13 15:47:44 user devstack@n-api.service[61871]: ERROR nova.api.openstack.wsgi Apr 13 15:47:44 user devstack@n-api.service[61871]: DEBUG nova.api.openstack.wsgi [None req-7790d38f-aa1e-4ccd-b751-3238beaa2334 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Returning 404 to user: Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 could not be found. {{(pid=61871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:47:44 user devstack@n-api.service[61871]: INFO nova.api.openstack.requestlog [None req-7790d38f-aa1e-4ccd-b751-3238beaa2334 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12" status: 404 len: 111 microversion: 2.1 time: 0.035537 Apr 13 15:47:44 user devstack@n-api.service[61871]: [pid: 61871|app: 0|req: 386/1166] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 15:47:44 2023] DELETE /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:47:44 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:47:44 user devstack@n-api.service[61872]: DEBUG dbcounter [-] [61872] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61872) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 15:47:44 user devstack@n-api.service[61872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 15:47:44 user devstack@n-api.service[61872]: Thu Apr 13 15:47:44 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12 (ip 10.0.0.210) !!! Apr 13 15:47:44 user devstack@n-api.service[61872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 15:47:44 user devstack@n-api.service[61872]: Thu Apr 13 15:47:44 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12 (ip 10.0.0.210) !!! Apr 13 15:47:44 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-3ff56b93-f32f-4187-8acc-5b26ce3b1abb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '>' {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:47:44 user devstack@n-api.service[61872]: DEBUG nova.compute.api [None req-3ff56b93-f32f-4187-8acc-5b26ce3b1abb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Fetching instance by UUID {{(pid=61872) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 15:47:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3ff56b93-f32f-4187-8acc-5b26ce3b1abb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:47:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3ff56b93-f32f-4187-8acc-5b26ce3b1abb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:47:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3ff56b93-f32f-4187-8acc-5b26ce3b1abb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:47:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3ff56b93-f32f-4187-8acc-5b26ce3b1abb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 15:47:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3ff56b93-f32f-4187-8acc-5b26ce3b1abb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 15:47:44 user devstack@n-api.service[61872]: DEBUG oslo_concurrency.lockutils [None req-3ff56b93-f32f-4187-8acc-5b26ce3b1abb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "10bda8e5-63c9-4a44-a524-4a0d8ed07a69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61872) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 15:47:44 user devstack@n-api.service[61872]: INFO nova.api.openstack.wsgi [None req-3ff56b93-f32f-4187-8acc-5b26ce3b1abb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HTTP exception thrown: Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 could not be found. Apr 13 15:47:44 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-3ff56b93-f32f-4187-8acc-5b26ce3b1abb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Request method failure captured: Apr 13 15:47:44 user devstack@n-api.service[61872]: request: GET /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12 HTTP/1.1 Apr 13 15:47:44 user devstack@n-api.service[61872]: Accept: application/json Apr 13 15:47:44 user devstack@n-api.service[61872]: Accept-Encoding: identity Apr 13 15:47:44 user devstack@n-api.service[61872]: Connection: close Apr 13 15:47:44 user devstack@n-api.service[61872]: Content-Length: 0 Apr 13 15:47:44 user devstack@n-api.service[61872]: Content-Type: application/json Apr 13 15:47:44 user devstack@n-api.service[61872]: Host: 10.0.0.210 Apr 13 15:47:44 user devstack@n-api.service[61872]: Openstack-System-Scope: None Apr 13 15:47:44 user devstack@n-api.service[61872]: User-Agent: python-urllib3/1.26.15 Apr 13 15:47:44 user devstack@n-api.service[61872]: X-Auth-Token: gAAAAABkOCAkop2IkGDfTg_hLFhCzVF0r-Snnfp8mpD-rNTz3fSyNRaGCKUvuIX-bvQSQt24XSPbyAQXj1tiZH1C9TwK7awcWO7BHnx8xBG9YOZB63Dpng-DDIXtPRCA4OT9QRrpOESCL1mwTOYQNnj8ZeocbvX0wE2u-g1UjUjvIIUGz4v71K0 Apr 13 15:47:44 user devstack@n-api.service[61872]: X-Domain-Id: None Apr 13 15:47:44 user devstack@n-api.service[61872]: X-Domain-Name: None Apr 13 15:47:44 user devstack@n-api.service[61872]: X-Identity-Status: Confirmed Apr 13 15:47:44 user devstack@n-api.service[61872]: X-Is-Admin-Project: True Apr 13 15:47:44 user devstack@n-api.service[61872]: X-Project-Domain-Id: default Apr 13 15:47:44 user devstack@n-api.service[61872]: X-Project-Domain-Name: Default Apr 13 15:47:44 user devstack@n-api.service[61872]: X-Project-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:47:44 user devstack@n-api.service[61872]: X-Project-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:47:44 user devstack@n-api.service[61872]: X-Role: member,reader Apr 13 15:47:44 user devstack@n-api.service[61872]: X-Roles: member,reader Apr 13 15:47:44 user devstack@n-api.service[61872]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5d7f771264c4cd2bc595a2c525082d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 13 15:47:44 user devstack@n-api.service[61872]: X-Tenant: tempest-TestVolumeBootPattern-374778702 Apr 13 15:47:44 user devstack@n-api.service[61872]: X-Tenant-Id: d5d7f771264c4cd2bc595a2c525082d0 Apr 13 15:47:44 user devstack@n-api.service[61872]: X-Tenant-Name: tempest-TestVolumeBootPattern-374778702 Apr 13 15:47:44 user devstack@n-api.service[61872]: X-User: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:47:44 user devstack@n-api.service[61872]: X-User-Domain-Id: default Apr 13 15:47:44 user devstack@n-api.service[61872]: X-User-Domain-Name: Default Apr 13 15:47:44 user devstack@n-api.service[61872]: X-User-Id: 0307fb8d127a41079e34355904352231 Apr 13 15:47:44 user devstack@n-api.service[61872]: X-User-Name: tempest-TestVolumeBootPattern-374778702-project-member Apr 13 15:47:44 user devstack@n-api.service[61872]: method: > Apr 13 15:47:44 user devstack@n-api.service[61872]: exception: Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 could not be found. Apr 13 15:47:44 user devstack@n-api.service[61872]: action_args: {'id': '4a17bf49-ffae-4178-b484-6c45bd80fb12'} Apr 13 15:47:44 user devstack@n-api.service[61872]: {{(pid=61872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 could not be found. Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 could not be found. Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 could not be found. Apr 13 15:47:44 user devstack@n-api.service[61872]: ERROR nova.api.openstack.wsgi Apr 13 15:47:44 user devstack@n-api.service[61872]: DEBUG nova.api.openstack.wsgi [None req-3ff56b93-f32f-4187-8acc-5b26ce3b1abb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Returning 404 to user: Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 could not be found. {{(pid=61872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 15:47:44 user devstack@n-api.service[61872]: INFO nova.api.openstack.requestlog [None req-3ff56b93-f32f-4187-8acc-5b26ce3b1abb tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12" status: 404 len: 111 microversion: 2.1 time: 0.043734 Apr 13 15:47:44 user devstack@n-api.service[61872]: [pid: 61872|app: 0|req: 390/1167] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 15:47:44 2023] GET /compute/v2.1/servers/4a17bf49-ffae-4178-b484-6c45bd80fb12 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 15:47:46 user devstack@n-api.service[61873]: DEBUG nova.api.openstack.wsgi [None req-c2edcf3b-bf65-41c2-a19c-0011c3917448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Calling method '.version_select at 0x7f3a8b7c0c10>' {{(pid=61873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 15:47:46 user devstack@n-api.service[61873]: INFO nova.api.openstack.requestlog [None req-c2edcf3b-bf65-41c2-a19c-0011c3917448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-534201410" status: 202 len: 0 microversion: 2.1 time: 0.028559 Apr 13 15:47:46 user devstack@n-api.service[61873]: [pid: 61873|app: 0|req: 392/1168] 10.0.0.210 () {62 vars in 1337 bytes} [Thu Apr 13 15:47:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-534201410 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)